-- Logs begin at Thu 2022-08-04 20:01:44 UTC, end at Thu 2022-08-04 21:17:08 UTC. -- Aug 04 20:45:59.665077 dv-cinder-836027-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 20:45:59.675053 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 20:45:59 2022] *** Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: nodename: dv-cinder-836027-4-iscsi Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: machine: x86_64 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: clock source: unix Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: pcre jit disabled Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: detected number of CPU cores: 4 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: current working directory: / Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: detected binary path: /usr/bin/uwsgi-core Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: your processes number limit is 47680 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: your memory page size is 4096 bytes Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: detected max file descriptor number: 2048 Aug 04 20:45:59.676606 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: lock engine: pthread robust mutexes Aug 04 20:45:59.677442 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: thunder lock: enabled Aug 04 20:45:59.677442 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 20:45:59.677442 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 20:45:59.717895 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: Python main interpreter initialized at 0x556c08c209c0 Aug 04 20:45:59.717895 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: python threads support enabled Aug 04 20:45:59.717895 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: your server socket listen backlog is limited to 100 connections Aug 04 20:45:59.717895 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: your mercy for graceful operations on workers is 90 seconds Aug 04 20:45:59.718254 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 20:45:59.718330 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: *** Operational MODE: preforking *** Aug 04 20:45:59.718553 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: *** uWSGI is running in multiple interpreter mode *** Aug 04 20:45:59.718553 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: spawned uWSGI master process (pid: 109880) Aug 04 20:45:59.718740 dv-cinder-836027-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 20:45:59.720062 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: spawned uWSGI worker 1 (pid: 109881, cores: 1) Aug 04 20:45:59.720062 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: spawned uWSGI worker 2 (pid: 109882, cores: 1) Aug 04 20:45:59.720062 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 20:46:00.380688 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 20:46:00.388408 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 20:46:01.472138 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:46:01.472138 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: from cryptography.utils import int_from_bytes Aug 04 20:46:01.472762 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:46:01.472762 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: from cryptography.utils import int_from_bytes Aug 04 20:46:01.473988 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:46:01.473988 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: from cryptography.utils import int_from_bytes Aug 04 20:46:01.474398 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:46:01.474398 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: from cryptography.utils import int_from_bytes Aug 04 20:46:03.949156 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:46:03.949685 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:46:03.949784 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:46:03.949784 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:46:03.950178 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:46:03.950178 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:46:03.950321 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:46:03.950450 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:46:03.950602 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:46:03.950815 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:46:03.950933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951142 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951244 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951463 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951553 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951782 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.951887 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952111 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952222 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952439 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952532 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952760 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.952849 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953078 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953175 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953393 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953479 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953649 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953736 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.953964 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954061 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954278 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954371 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-4-iscsi {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954593 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954692 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-4-iscsi {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954899 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.954986 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955211 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955298 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955517 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955615 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955818 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.955911 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956124 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956220 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956465 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956568 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956797 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.956968 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.957306 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.957456 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.957620 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.957749 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.957922 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958040 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958235 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958383 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958578 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958695 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.958899 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959016 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959208 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959311 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959516 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959608 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959826 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.959919 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960148 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960250 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960490 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960637 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-4-iscsi {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960901 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-4-iscsi {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.960990 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961218 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961336 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961517 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961831 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.961921 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962223 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962323 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962534 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962624 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962842 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.962928 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.963162 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.963290 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964053 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964383 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964537 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964718 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.964808 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965039 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965360 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965456 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965683 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965771 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.965986 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966079 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966293 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966381 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966602 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966691 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966905 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.966991 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967212 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967308 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967550 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967753 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.967840 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968063 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968406 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968507 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968730 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968821 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.968984 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969090 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969234 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969322 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969527 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969613 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969849 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.969938 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970155 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970249 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970463 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970558 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970771 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.970865 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971082 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971194 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971387 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971484 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971694 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.971791 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972014 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972109 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972300 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972431 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972636 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972722 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.972950 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973033 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973264 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973356 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973570 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973653 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973883 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.973965 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974204 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974298 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974510 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974594 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974817 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.974901 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975142 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975235 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975464 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975548 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975771 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.975855 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976081 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976166 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976419 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976506 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976727 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.976822 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977031 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977117 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977335 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977418 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977644 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977728 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.977964 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978050 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978265 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978356 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978512 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978606 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978811 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.978908 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979232 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979318 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979546 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979646 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979848 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.979933 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980247 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980481 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980649 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980779 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.980863 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981077 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981167 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981380 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981479 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981701 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981794 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.981986 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982078 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982390 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982587 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982671 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982890 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.982973 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983189 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983280 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983490 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983576 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983791 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.983880 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984111 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984197 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984436 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984525 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984742 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.984836 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985045 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985132 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985350 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985442 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985658 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985742 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.985961 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986062 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986262 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986355 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986566 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986649 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986868 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.986959 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987169 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987253 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987469 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987564 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987773 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.987858 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988076 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988160 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988389 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988491 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988700 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988787 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.988997 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989083 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989303 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989396 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989605 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989689 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989906 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.989997 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990306 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990504 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990588 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990805 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.990896 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991104 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991196 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991403 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991487 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991702 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991787 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.991994 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992088 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992289 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992408 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992631 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992716 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.992947 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993038 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993252 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993336 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993551 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993634 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993851 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.993936 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.994169 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:46:03.994254 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.994522 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.994612 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.994867 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995075 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995198 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995501 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995601 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995825 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.995921 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996138 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996225 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996474 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996564 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996790 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.996877 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997114 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997200 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997422 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997507 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997731 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.997817 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998041 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998126 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998357 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998441 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998672 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998764 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.998997 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999100 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999309 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999394 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999625 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999711 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:03.999945 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000036 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000255 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000356 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000599 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000694 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000913 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.000998 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001234 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001318 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001545 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001633 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001877 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.001993 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002192 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002292 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002512 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002597 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002834 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.002919 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003246 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003465 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003557 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003773 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.003858 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004084 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004210 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004420 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004510 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004744 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.004830 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005057 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005155 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005375 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005460 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005687 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.005772 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006000 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006093 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006308 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006407 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006620 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006706 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.006928 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007013 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007240 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007323 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007557 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007648 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007868 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.007953 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008180 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008264 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008519 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008616 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008829 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.008915 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009139 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009231 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009448 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009533 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009752 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.009846 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.010054 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.010769 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.010863 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.010951 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011173 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011319 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011473 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011559 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011792 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.011897 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012115 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012201 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012539 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012777 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.012876 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013082 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013174 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013391 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013476 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013698 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.013792 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014008 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014094 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014312 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014398 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014623 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014709 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.014932 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015030 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015239 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015324 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015553 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015645 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015860 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.015943 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016164 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016249 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016505 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016592 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016807 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.016890 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017110 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017197 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017422 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017509 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017728 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.017813 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018035 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018131 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018346 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018431 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018656 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018750 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.018968 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019061 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019276 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019363 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019607 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019710 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019904 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.019997 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020222 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020308 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020554 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020651 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020878 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.020964 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021198 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021282 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021511 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021596 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021815 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.021910 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022124 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022262 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022430 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022517 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022732 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.022831 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023035 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023133 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023339 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023424 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023723 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.023941 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024025 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024244 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024330 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024570 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024664 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024873 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.024965 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.025176 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.025267 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.025482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.025574 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.025836 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026063 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026169 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026247 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026489 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026704 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.026801 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027044 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027128 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027655 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027769 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027843 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.027907 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.028007 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.028329 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029024 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029154 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029236 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029304 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029304 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029431 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029835 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.029958 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030044 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030118 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030186 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030410 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030527 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030736 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.030841 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031056 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031147 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031378 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031477 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031686 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031805 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.031994 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032091 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032311 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032434 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032732 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.032952 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033052 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033268 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033353 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033598 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033682 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.033913 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034005 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034234 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034318 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034541 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034624 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034852 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.034944 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035168 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035254 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035479 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035564 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035786 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.035880 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036096 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036190 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036437 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036527 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036749 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.036848 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037065 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037159 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037372 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037457 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037682 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037768 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.037989 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038074 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038309 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038400 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038609 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038706 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.038920 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039006 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039228 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039312 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039555 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039689 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039860 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.039952 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040171 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040257 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040500 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040598 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040820 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.040918 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.041126 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.041223 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042040 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042262 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042349 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042416 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042640 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.042916 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043003 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043247 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043332 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043552 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043637 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043860 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.043946 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044164 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044249 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044496 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044585 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044805 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.044890 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045108 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045194 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045410 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045724 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.045818 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046033 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046117 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046337 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046430 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046653 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046739 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.046967 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047059 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047267 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047361 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047568 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047652 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047880 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.047964 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048184 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048275 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048512 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048600 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048813 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.048898 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049115 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049201 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049441 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049748 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.049833 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.050047 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.050140 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.050360 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.050713 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.050932 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051015 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051237 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051322 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051545 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051849 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.051940 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052154 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052287 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052496 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052586 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052807 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.052910 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053114 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053200 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053420 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053505 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053728 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.053822 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054037 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054122 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054344 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054430 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054663 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054765 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.054969 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055054 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055277 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055361 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055591 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055684 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055891 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.055975 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.056198 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.056283 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.056536 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.056634 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.056867 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.057705 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.057946 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058114 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058292 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058402 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058585 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058674 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058895 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.058984 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.059214 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.059310 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.059538 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.059633 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.059864 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060107 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060207 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060471 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060576 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060795 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.060882 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061119 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061213 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061421 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061508 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061730 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.061817 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062035 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062131 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062339 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062460 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062639 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062748 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.062946 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063051 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063246 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063349 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063545 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063633 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063845 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.063931 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064146 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064247 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064480 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064582 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064784 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.064871 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065092 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065182 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065392 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065480 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065698 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.065784 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066005 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066093 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066305 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066392 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066606 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066692 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.066909 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067004 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067214 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067313 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067526 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067614 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067833 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.067928 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068159 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068246 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068496 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068601 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068807 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.068903 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069105 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069191 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069410 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069506 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069717 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.069803 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070022 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070122 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070322 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070423 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070717 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.070935 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071023 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071236 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071335 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071546 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071634 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071854 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.071942 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.072161 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.072250 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.072494 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.072641 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.072906 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073038 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073279 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073395 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073546 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073655 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073858 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.073949 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074166 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074256 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074468 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074564 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074769 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.074866 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075078 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075167 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075384 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075486 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075689 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075790 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.075996 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076083 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076298 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076420 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076637 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076742 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.076939 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077027 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077240 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077328 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077542 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077638 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077849 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.077946 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078151 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078246 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078453 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078540 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078757 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.078845 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079071 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079157 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079373 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079462 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079674 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079761 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.079980 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080127 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080283 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080413 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080612 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080700 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.080915 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081002 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081234 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081323 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081546 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081639 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081845 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.081940 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082148 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082242 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082448 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082600 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082750 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.082855 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083052 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083148 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083354 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083450 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083653 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083749 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.083950 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084037 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084248 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084376 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084575 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084676 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084878 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.084975 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085181 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085269 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085491 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085581 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085791 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.085916 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086092 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086186 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086391 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086481 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086692 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086778 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.086996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087091 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087300 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087390 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087626 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087714 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.087939 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088025 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088304 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088503 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088648 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088795 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.088948 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089103 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089337 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089447 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089661 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089749 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.089982 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090085 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090294 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090396 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090604 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090698 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.090906 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091006 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091209 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091297 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091529 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091616 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091837 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.091933 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092141 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092228 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092574 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092798 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.092971 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093106 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093191 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093405 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093491 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093708 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.093797 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094016 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094102 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094321 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094408 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094628 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094723 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.094933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095028 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095242 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095328 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095559 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095647 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095863 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.095955 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096173 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096298 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096509 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096620 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096816 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.096911 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097123 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097242 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097430 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097525 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097734 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.097830 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098045 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098146 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098350 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098443 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098653 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098754 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.098959 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099066 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099262 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099356 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099570 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099671 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.099871 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100043 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100255 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100383 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100587 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100681 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.100901 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101004 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101208 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101302 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101514 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101610 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101819 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.101912 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102131 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102231 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102433 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102526 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102734 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.102865 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.103150 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.103243 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.103461 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.103548 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.103769 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.104514 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.104670 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.104828 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.104997 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105277 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105378 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105599 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105687 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105907 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.105995 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106253 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106342 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106561 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106648 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106869 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.106956 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107175 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107264 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107501 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107607 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107805 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.107893 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108113 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108206 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108533 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108624 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108845 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.108947 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109148 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109243 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109453 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109566 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109779 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.109873 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110085 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110179 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110410 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110495 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110786 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.110877 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111108 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111193 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111413 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111506 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111724 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.111819 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112032 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112117 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112375 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112464 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112703 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.112813 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113014 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113117 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113327 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113526 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113662 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113798 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.113941 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114086 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114235 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114378 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114525 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114662 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114849 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.114983 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115193 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115329 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115518 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115652 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115826 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.115964 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116150 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116283 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116500 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116646 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116792 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.116927 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117094 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117227 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117402 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117562 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117705 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117842 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.117998 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118137 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118322 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118463 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118611 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118746 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.118923 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.119061 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.119233 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.119382 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.120115 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.120377 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.120546 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.120704 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.120852 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121046 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121155 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121378 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121473 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121687 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.121783 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122012 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122100 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122320 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122406 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122627 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122721 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.122934 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123245 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123342 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123550 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123659 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123860 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.123956 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124249 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124488 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124590 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124794 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.124881 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125110 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125196 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125426 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125512 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125738 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.125823 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126044 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126131 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126352 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126439 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126658 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.126745 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127001 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127086 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127304 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127390 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127630 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127780 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.127926 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128063 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128250 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128401 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128580 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128668 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128882 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.128982 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129193 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129293 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129498 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129586 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129800 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.129896 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130104 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130199 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130412 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130500 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130713 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.130814 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131013 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131117 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131316 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131416 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131626 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131732 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.131926 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132014 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132234 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132321 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132577 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132668 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132881 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.132969 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133183 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133271 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133485 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133578 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133825 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.133949 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134216 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134455 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134764 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.134852 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135108 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135206 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135479 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135646 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135783 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.135871 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136097 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136201 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136441 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136534 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136759 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.136847 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137074 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137180 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137390 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137479 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137698 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.137842 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138015 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138116 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138329 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138417 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138647 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138736 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.138962 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139180 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139270 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139506 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139594 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139818 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.139914 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.140128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.140217 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.140462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.140552 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.140779 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141032 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141124 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141368 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141483 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141682 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141778 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.141988 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142084 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142298 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142393 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142613 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142715 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.142930 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143025 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143244 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143339 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143560 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143669 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143874 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.143995 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144180 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144281 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144601 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144720 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144835 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.144986 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145182 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145292 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145491 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145581 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145798 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.145895 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146109 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146198 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146422 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146511 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146733 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.146819 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147046 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147143 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147356 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147454 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147667 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147756 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.147978 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148196 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148368 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148470 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148609 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148698 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.148921 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149017 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149231 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149328 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149543 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149630 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149857 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.149946 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.150168 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.150260 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.150475 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.150563 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.151324 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.151486 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.151637 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.151788 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.151952 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.152232 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.152365 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.152583 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.152674 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.152913 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153000 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153228 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153317 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153546 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153696 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.153860 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154076 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154225 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154381 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154471 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154714 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.154802 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155042 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155138 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155363 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155457 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155674 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155762 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.155977 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156149 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156299 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156452 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156633 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156719 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.156936 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157069 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157245 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157339 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157551 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157638 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.157854 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158081 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158178 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158430 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158519 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158748 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.158845 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159071 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159156 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159382 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159469 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159696 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.159913 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160001 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160265 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160404 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160606 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160709 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.160935 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161024 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161248 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161334 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161559 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161656 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161863 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.161952 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162167 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162313 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162478 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162575 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162782 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.162870 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163084 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163171 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163394 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163483 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163698 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.163788 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164005 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164100 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164307 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164441 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164637 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164726 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.164939 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165025 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165247 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165335 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165552 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165853 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.165947 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.166155 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.166245 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167020 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167173 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167304 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167479 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167631 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167732 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.167913 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168003 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168219 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168353 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168551 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168653 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168856 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.168944 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169166 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169261 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169469 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169556 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169775 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.169888 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170076 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170182 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170389 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170484 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170696 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.170785 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171008 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171173 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171314 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171406 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171624 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171711 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.171932 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172026 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172275 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172424 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172616 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172703 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.172929 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173142 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173254 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173479 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173567 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173800 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.173899 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.174132 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.174221 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.174460 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.174549 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.174767 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.175021 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.175110 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.175361 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.175713 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.175950 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176045 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176260 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176366 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176607 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176702 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.176922 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177020 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177231 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177324 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177537 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177624 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177846 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.177947 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178156 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178244 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178465 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178552 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178772 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.178869 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179080 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179168 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179387 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179474 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179694 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.179790 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180000 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180088 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180307 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180425 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180640 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180729 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.180953 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181041 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181264 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181365 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181577 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181665 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.181888 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182007 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182239 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182407 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182548 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182700 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.182923 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183020 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183264 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183364 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183578 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183674 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183895 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.183988 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184226 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184328 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184566 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184669 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184869 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.184956 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185184 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185272 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185497 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185585 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185816 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.185950 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186151 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186242 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186467 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186562 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186774 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.186879 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187110 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187421 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187517 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187742 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.187842 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188052 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188139 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188400 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188492 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188736 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.188837 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189059 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189375 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189470 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189676 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189764 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.189979 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190067 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190281 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190368 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190586 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190675 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190903 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.190990 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191212 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191306 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191515 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191603 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191815 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.191902 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192123 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192218 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192458 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192548 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192764 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.192872 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193063 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193165 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193364 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193452 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193667 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193761 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.193965 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194103 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194265 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194354 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194564 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194651 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194863 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.194964 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195251 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195466 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195554 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.195869 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196068 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196155 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196393 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196486 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196689 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196787 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.196991 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197146 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197622 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197740 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.197935 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198096 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198250 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198380 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198533 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198645 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198839 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.198956 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199145 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199323 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199477 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199568 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199811 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.199899 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200128 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200224 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200481 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200573 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200798 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.200886 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201122 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201222 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201430 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201518 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201744 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.201833 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202058 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202158 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202370 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202457 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202679 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202824 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.202991 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203094 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203308 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203396 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203626 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203715 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.203930 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204018 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204244 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204384 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204580 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204716 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204895 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.204986 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205209 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205296 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205613 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205844 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.205939 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206156 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206242 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206470 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206566 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206786 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.206882 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207100 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207189 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207411 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207517 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207728 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.207817 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208039 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208134 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208362 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208510 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208688 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.208784 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209005 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209102 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209331 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209429 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209656 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209752 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.209967 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210057 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210292 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210381 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210617 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210706 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.210958 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211046 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211269 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211363 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211605 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211692 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.211920 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212021 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212230 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212317 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212578 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212670 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.212885 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.213004 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.213136 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:46:04.213774 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.214095 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.214426 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.214742 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.215064 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.215374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:46:04.215618 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:46:04.365977 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Registered counter for database nova_api Aug 04 20:46:04.369228 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO dbcounter [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Registered counter for database nova_api Aug 04 20:46:04.387381 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.390584 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.394137 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.397283 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writer thread running {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.452065 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.context [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc954cb4-bb24-40a9-85b5-b62168d68e97(cell1) {{(pid=109881) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 20:46:04.455809 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.context [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc954cb4-bb24-40a9-85b5-b62168d68e97(cell1) {{(pid=109882) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 20:46:04.455952 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:46:04.456288 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:46:04.458009 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:46:04.458721 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:46:04.459159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:46:04.459674 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:46:04.460146 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:46:04.461183 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:46:04.461769 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:46:04.462523 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:46:04.462968 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:46:04.463158 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Registered counter for database nova_cell0 Aug 04 20:46:04.465530 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_concurrency.lockutils [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:46:04.467587 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO dbcounter [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Registered counter for database nova_cell0 Aug 04 20:46:04.468721 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Registered counter for database nova_cell1 Aug 04 20:46:04.473028 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO dbcounter [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Registered counter for database nova_cell1 Aug 04 20:46:04.476254 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.477469 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.479877 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.483964 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.484569 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.485515 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writer thread running {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.486492 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.624916 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writer thread running {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.628994 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Registered counter for database nova_cell0 Aug 04 20:46:04.633786 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO dbcounter [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Registered counter for database nova_cell0 Aug 04 20:46:04.638292 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.641183 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:46:04.642939 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.645817 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writer thread running {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:46:04.986004 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: WARNING keystonemiddleware.auth_token [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:46:04.986682 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:46:04.993307 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: WARNING keystonemiddleware.auth_token [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:46:04.993432 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:46:05.341138 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: WARNING keystonemiddleware.auth_token [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:46:05.341734 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:46:05.347158 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: WARNING keystonemiddleware.auth_token [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:46:05.347738 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:46:05.352443 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c08c209c0 pid: 109882 (default app) Aug 04 20:46:05.353031 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c08c209c0 pid: 109881 (default app) Aug 04 20:46:05.355245 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:46:05.356438 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-bdb49188-3ed4-412f-8be1-9c5f5d7c5fce None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002461 Aug 04 20:46:05.356852 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Aug 4 20:46:05 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:22.612771 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:22.614006 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Aug 04 20:47:22.614397 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:22.626348 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_api:SELECT=3 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.627192 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_cell0:SELECT=3 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.628311 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_cell1:SELECT=3 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.629230 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.506582 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-fcb0a0e8-3d0f-4fdc-8a16-328bdab6a3df admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:23.538928 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-fcb0a0e8-3d0f-4fdc-8a16-328bdab6a3df admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917721 Aug 04 20:47:23.539736 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Aug 4 20:47:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:25.809822 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:25.810830 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-493ec4b8-0fa2-4a61-813f-ec464c254e78 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 04 20:47:25.811392 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:26.349051 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-045e3df2-d0c5-4c51-9ce1-d2897cf22c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:26.370081 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:47:26.370081 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: warnings.warn(msg) Aug 04 20:47:26.399636 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-045e3df2-d0c5-4c51-9ce1-d2897cf22c5d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.582227 Aug 04 20:47:26.400523 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:26.414933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:26.415815 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:26.416568 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell1:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:26.417553 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:26.623610 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3be8cf27-4799-450e-bf3b-e72ae7886147 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:26.627940 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:47:26.627940 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:47:26.694172 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3be8cf27-4799-450e-bf3b-e72ae7886147 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285286 Aug 04 20:47:26.695056 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Aug 4 20:47:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:47:28.971356 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-045e3df2-d0c5-4c51-9ce1-d2897cf22c5d admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:28.972447 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-045e3df2-d0c5-4c51-9ce1-d2897cf22c5d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 04 20:47:28.978888 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:47:29.771638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-10d01752-0321-4fa1-89b6-099adedbc3bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "vcpus": 1}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:29.792163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:47:29.792163 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:47:29.827932 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-10d01752-0321-4fa1-89b6-099adedbc3bb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.847112 Aug 04 20:47:29.829050 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:29.842225 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-afce4587-fe46-4232-8fd0-e96f0ab156dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:29.845775 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:47:29.845775 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: warnings.warn(msg) Aug 04 20:47:29.883469 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-afce4587-fe46-4232-8fd0-e96f0ab156dc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044921 Aug 04 20:47:29.884333 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Aug 4 20:47:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:32.242833 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-10d01752-0321-4fa1-89b6-099adedbc3bb admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:32.243859 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-10d01752-0321-4fa1-89b6-099adedbc3bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Aug 04 20:47:32.244260 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:32.651450 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0983c1b5-b814-4993-a0fe-14c028765afb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:32.671255 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0983c1b5-b814-4993-a0fe-14c028765afb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420823 Aug 04 20:47:32.672000 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:32.684941 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-c17da9c5-5de3-47fa-b8de-1408022752cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:32.709643 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-c17da9c5-5de3-47fa-b8de-1408022752cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028505 Aug 04 20:47:32.710237 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Aug 4 20:47:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:47:34.955582 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0983c1b5-b814-4993-a0fe-14c028765afb admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:34.956650 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0983c1b5-b814-4993-a0fe-14c028765afb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 04 20:47:34.957080 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:35.403028 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-b3c59b69-5208-4643-8133-bbe852f4432a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "swap": 0, "vcpus": 2}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:35.423232 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-b3c59b69-5208-4643-8133-bbe852f4432a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459560 Aug 04 20:47:35.423762 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:35.439221 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-abfc7ab0-a256-4d08-81c1-39c09b3422a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:35.464091 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-abfc7ab0-a256-4d08-81c1-39c09b3422a7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028744 Aug 04 20:47:35.464707 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Aug 4 20:47:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:37.746409 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-b3c59b69-5208-4643-8133-bbe852f4432a admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:37.747425 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-b3c59b69-5208-4643-8133-bbe852f4432a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 04 20:47:37.747850 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:38.198547 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "name": "ds4G"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:38.221858 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466087 Aug 04 20:47:38.222752 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:38.237042 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3f583d46-1c95-4936-8263-43caf07c8294 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:38.266009 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3f583d46-1c95-4936-8263-43caf07c8294 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032701 Aug 04 20:47:38.266758 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Aug 4 20:47:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:40.541170 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:40.542189 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 04 20:47:40.542597 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:41.014520 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-5f4f6314-62dd-476e-af31-edbed4fa6910 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:41.039773 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-5f4f6314-62dd-476e-af31-edbed4fa6910 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489832 Aug 04 20:47:41.040437 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Aug 4 20:47:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:47:43.283793 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:43.284877 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6a55b2f5-161a-4a62-aef4-ca110adeef8d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 20:47:43.285224 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:43.724958 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-4daa45f8-3130-4f50-a4d7-1db05db0e182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:43.748001 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-4daa45f8-3130-4f50-a4d7-1db05db0e182 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455938 Aug 04 20:47:43.748980 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:43.764029 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-cb2e5895-0ab8-409a-bf7a-0715263740e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:43.790030 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-cb2e5895-0ab8-409a-bf7a-0715263740e6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029633 Aug 04 20:47:43.790468 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Aug 4 20:47:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:47:46.011284 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-4daa45f8-3130-4f50-a4d7-1db05db0e182 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:46.012317 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-4daa45f8-3130-4f50-a4d7-1db05db0e182 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 20:47:46.012754 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:46.418429 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-391e5388-c6a7-48c9-b5f9-bb214a006770 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:46.438887 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-391e5388-c6a7-48c9-b5f9-bb214a006770 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420020 Aug 04 20:47:46.439432 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:46.451866 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-bd69be54-8c7e-4e6b-8f81-a0da74b40ebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:46.476710 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-bd69be54-8c7e-4e6b-8f81-a0da74b40ebf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028270 Aug 04 20:47:46.477493 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Aug 4 20:47:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:47:48.700807 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-391e5388-c6a7-48c9-b5f9-bb214a006770 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:48.701805 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-391e5388-c6a7-48c9-b5f9-bb214a006770 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 04 20:47:48.702201 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:49.126603 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-98c3f8db-375f-4f5b-88e6-c66ce7352a50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:49.145468 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-98c3f8db-375f-4f5b-88e6-c66ce7352a50 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.437069 Aug 04 20:47:49.146222 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:49.159811 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-7a2b5bb4-267a-4db1-b207-3a506950a418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:49.185872 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-7a2b5bb4-267a-4db1-b207-3a506950a418 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030514 Aug 04 20:47:49.186611 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Aug 4 20:47:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:51.468505 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-98c3f8db-375f-4f5b-88e6-c66ce7352a50 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:51.470122 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-98c3f8db-375f-4f5b-88e6-c66ce7352a50 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Aug 04 20:47:51.470824 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:51.950508 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-e97bf99c-7af0-4943-b80c-2d27f56717bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "id": "4", "swap": 0, "vcpus": 4, "ram": 8192}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:51.969583 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-e97bf99c-7af0-4943-b80c-2d27f56717bf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492087 Aug 04 20:47:51.970128 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:51.982173 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-7f827aff-a6d4-432d-b7c6-d610142dbc06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:52.009326 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-7f827aff-a6d4-432d-b7c6-d610142dbc06 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030658 Aug 04 20:47:52.009991 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Aug 4 20:47:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:47:54.270036 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-e97bf99c-7af0-4943-b80c-2d27f56717bf admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:47:54.271050 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-e97bf99c-7af0-4943-b80c-2d27f56717bf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 04 20:47:54.272385 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:47:54.769589 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:54.791440 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.512843 Aug 04 20:47:54.791919 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Aug 4 20:47:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:54.804277 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-181e4dfd-706a-41b3-91c8-5846c3c3c92d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:47:54.809494 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:54.832893 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-181e4dfd-706a-41b3-91c8-5846c3c3c92d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031900 Aug 04 20:47:54.848415 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Aug 4 20:47:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:48:15.512477 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:15.513598 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 04 20:48:15.514073 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:16.040448 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-fa4fbc16-4381-4ff0-84ba-b83d66ef27f4 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:16.059331 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-fa4fbc16-4381-4ff0-84ba-b83d66ef27f4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.538957 Aug 04 20:48:16.059807 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Aug 4 20:48:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:17.128252 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:17.129306 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-69837f01-c70d-4c47-baca-9efff3ffb6bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 20:48:17.129705 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:17.673969 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-801f6abd-78b2-4ed4-8256-a43b196d9083 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:17.680267 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.wsgi [None req-801f6abd-78b2-4ed4-8256-a43b196d9083 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-801f6abd-78b2-4ed4-8256-a43b196d9083 admin admin] Request method failure captured: Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept: application/json Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept-Encoding: gzip, deflate Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Connection: keep-alive Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Content-Length: 0 Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Host: 10.222.0.52 Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-System-Scope: None Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: User-Agent: python-novaclient Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Auth-Token: gAAAAABi7DCRJMppefB6XwGSqt7gRMEM0pNq_yAYh9znaJrUydXaodP90fnnuex9Mk0ijXxMMK2FmSMjBxkCF6sMB-D-mN3yZWmi3iUU_4ywvgy1SN_0G_8QAdK_xtjZHd8HrPUMVUi9VhRWC2k-spV7bPFB5YD5LyrNWNja8tOB66MRg_y5jTQ Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Id: None Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Name: None Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Identity-Status: Confirmed Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Is-Admin-Project: True Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Id: default Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Name: Default Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Name: admin Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Role: admin,member,reader Aug 04 20:48:17.683544 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Roles: admin,member,reader Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant: admin Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Name: admin Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User: admin Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Id: default Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Name: Default Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Name: admin Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: method: > Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: exception: Flavor 42 could not be found. Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: action_args: {'id': '42'} Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:17.685205 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:17.686290 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.687768 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-801f6abd-78b2-4ed4-8256-a43b196d9083 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:17.689142 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-801f6abd-78b2-4ed4-8256-a43b196d9083 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.412497 Aug 04 20:48:17.689142 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Aug 4 20:48:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 20:48:17.695678 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-8450f9db-3fdd-411d-918d-84b79f30e6c2 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:17.700025 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:17.721716 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-8450f9db-3fdd-411d-918d-84b79f30e6c2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030463 Aug 04 20:48:17.722298 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:17.732120 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-7b96a99c-210b-48dc-abc1-d63c34381de7 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:17.757289 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-7b96a99c-210b-48dc-abc1-d63c34381de7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028402 Aug 04 20:48:17.757839 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:17.767319 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-db6ce60d-b140-4ee9-923f-92106a50a2e2 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:17.774297 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-db6ce60d-b140-4ee9-923f-92106a50a2e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-db6ce60d-b140-4ee9-923f-92106a50a2e2 admin admin] Request method failure captured: Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Host: 10.222.0.52 Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi7DCRJMppefB6XwGSqt7gRMEM0pNq_yAYh9znaJrUydXaodP90fnnuex9Mk0ijXxMMK2FmSMjBxkCF6sMB-D-mN3yZWmi3iUU_4ywvgy1SN_0G_8QAdK_xtjZHd8HrPUMVUi9VhRWC2k-spV7bPFB5YD5LyrNWNja8tOB66MRg_y5jTQ Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 04 20:48:17.777629 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User: admin Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: method: > Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: exception: Flavor 42 could not be found. Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: action_args: {'id': '42'} Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:17.779153 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:17.780128 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:17.781524 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-db6ce60d-b140-4ee9-923f-92106a50a2e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:17.782779 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-db6ce60d-b140-4ee9-923f-92106a50a2e2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015380 Aug 04 20:48:17.782779 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Aug 4 20:48:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 20:48:18.747367 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-7b96a99c-210b-48dc-abc1-d63c34381de7 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:18.748391 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-7b96a99c-210b-48dc-abc1-d63c34381de7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 04 20:48:18.748784 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:19.280538 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3c3a466c-4185-449d-8568-fd7723ac555d admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:19.285856 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-3c3a466c-4185-449d-8568-fd7723ac555d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3c3a466c-4185-449d-8568-fd7723ac555d admin admin] Request method failure captured: Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Host: 10.222.0.52 Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi7DCSkRm9kmCDLY0hCItCz5QC-Znvdrjw6jLWtgn6uFIDAIe-NzbYHBcEJFyVKc3_ssdH63LXk6qt2zodypM9kAIyP5LurUAGk1VZwM-naOkvXs6H1qCqIUWpW7LDHRizof5LJRfWewJ_upYX7fyH_XLH1_36ILmf0va4DP6H-zFPEZI Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 04 20:48:19.287933 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User: admin Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: method: > Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: exception: Flavor 84 could not be found. Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: action_args: {'id': '84'} Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:19.289462 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:19.292088 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.293159 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3c3a466c-4185-449d-8568-fd7723ac555d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:19.294262 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3c3a466c-4185-449d-8568-fd7723ac555d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398930 Aug 04 20:48:19.294262 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Aug 4 20:48:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 20:48:19.299065 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-4223fab0-1e14-4d7a-9e18-1115e4f0b8cc admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:19.314756 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-4223fab0-1e14-4d7a-9e18-1115e4f0b8cc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019226 Aug 04 20:48:19.315286 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:19.324688 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-7d9e2022-e661-4cf1-89b7-dd43e466d6c2 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:19.340109 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-7d9e2022-e661-4cf1-89b7-dd43e466d6c2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018856 Aug 04 20:48:19.340671 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:19.350553 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-da9a5e9b-37ca-43f1-985c-e55fa5fca722 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:19.355838 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.wsgi [None req-da9a5e9b-37ca-43f1-985c-e55fa5fca722 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-da9a5e9b-37ca-43f1-985c-e55fa5fca722 admin admin] Request method failure captured: Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept: application/json Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept-Encoding: gzip, deflate Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Connection: keep-alive Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Content-Length: 0 Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Host: 10.222.0.52 Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-System-Scope: None Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: User-Agent: python-novaclient Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Auth-Token: gAAAAABi7DCSkRm9kmCDLY0hCItCz5QC-Znvdrjw6jLWtgn6uFIDAIe-NzbYHBcEJFyVKc3_ssdH63LXk6qt2zodypM9kAIyP5LurUAGk1VZwM-naOkvXs6H1qCqIUWpW7LDHRizof5LJRfWewJ_upYX7fyH_XLH1_36ILmf0va4DP6H-zFPEZI Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Id: None Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Name: None Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Identity-Status: Confirmed Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Is-Admin-Project: True Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Id: default Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Name: Default Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Name: admin Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Role: admin,member,reader Aug 04 20:48:19.357336 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Roles: admin,member,reader Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant: admin Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Name: admin Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User: admin Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Id: default Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Name: Default Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Name: admin Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: method: > Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: exception: Flavor 84 could not be found. Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: action_args: {'id': '84'} Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:19.358923 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:19.359996 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:19.361504 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-da9a5e9b-37ca-43f1-985c-e55fa5fca722 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:19.362733 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-da9a5e9b-37ca-43f1-985c-e55fa5fca722 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012242 Aug 04 20:48:19.362733 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Aug 4 20:48:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 20:48:20.352218 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-7d9e2022-e661-4cf1-89b7-dd43e466d6c2 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:20.353251 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-7d9e2022-e661-4cf1-89b7-dd43e466d6c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 04 20:48:20.353647 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:20.879088 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-40540353-62b2-4bac-a560-b295b9120565 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:20.885320 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.wsgi [None req-40540353-62b2-4bac-a560-b295b9120565 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-40540353-62b2-4bac-a560-b295b9120565 admin admin] Request method failure captured: Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept: application/json Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Accept-Encoding: gzip, deflate Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Connection: keep-alive Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Content-Length: 0 Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Host: 10.222.0.52 Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Openstack-System-Scope: None Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: User-Agent: python-novaclient Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Auth-Token: gAAAAABi7DCUHdACxex-D0Y1zb2keRoXqj-SsRFCAc704aJwgOKpf502k4lwIZTt45KNKHKjv87HLOkx1-gO_1Qnldzk-W-yaRAIvmu567BfR7OKOBhEsuy_QzhitnmFXOKVNBuVz9SaovAsi8Uwb3eZgHOXy-2kyqAcAm8bWLcCeebFwyj01Gk Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Id: None Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Domain-Name: None Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Identity-Status: Confirmed Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Is-Admin-Project: True Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Id: default Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Domain-Name: Default Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Project-Name: admin Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Role: admin,member,reader Aug 04 20:48:20.886767 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Roles: admin,member,reader Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant: admin Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-Tenant-Name: admin Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User: admin Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Id: default Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Domain-Name: Default Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: X-User-Name: admin Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: method: > Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: exception: Flavor 451 could not be found. Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: action_args: {'id': '451'} Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:20.888373 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:20.889374 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.890482 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-40540353-62b2-4bac-a560-b295b9120565 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:20.891692 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-40540353-62b2-4bac-a560-b295b9120565 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397125 Aug 04 20:48:20.891692 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:48:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 20:48:20.898600 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-79bcda04-a167-48d3-9054-6d0f2596d479 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:20.913593 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-79bcda04-a167-48d3-9054-6d0f2596d479 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019288 Aug 04 20:48:20.914116 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:20.923270 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:20.938871 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019031 Aug 04 20:48:20.939404 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Aug 4 20:48:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:48:20.949847 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-6cc47a09-e1f7-4dd0-a42f-ac1735c276b6 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:20.955753 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-6cc47a09-e1f7-4dd0-a42f-ac1735c276b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-6cc47a09-e1f7-4dd0-a42f-ac1735c276b6 admin admin] Request method failure captured: Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Host: 10.222.0.52 Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi7DCUHdACxex-D0Y1zb2keRoXqj-SsRFCAc704aJwgOKpf502k4lwIZTt45KNKHKjv87HLOkx1-gO_1Qnldzk-W-yaRAIvmu567BfR7OKOBhEsuy_QzhitnmFXOKVNBuVz9SaovAsi8Uwb3eZgHOXy-2kyqAcAm8bWLcCeebFwyj01Gk Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 04 20:48:20.957286 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6dad5af55404a81a0a649f9204e78ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6dad5af55404a81a0a649f9204e78ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6dad5af55404a81a0a649f9204e78ff"}]}] Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Id: c6dad5af55404a81a0a649f9204e78ff Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User: admin Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Id: 477c6d25e4b7443fa6da61ccbe471661 Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: method: > Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: exception: Flavor 451 could not be found. Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: action_args: {'id': '451'} Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:48:20.959445 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:20.960735 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 04 20:48:20.962043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-6cc47a09-e1f7-4dd0-a42f-ac1735c276b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:48:20.963303 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-6cc47a09-e1f7-4dd0-a42f-ac1735c276b6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012317 Aug 04 20:48:20.963303 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:48:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 20:48:21.970404 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:21.971403 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 04 20:48:21.971801 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:22.511277 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-29589730-5887-49d2-89e8-fab32272fe9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:48:22.530597 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-29589730-5887-49d2-89e8-fab32272fe9c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.421083 Aug 04 20:48:22.531155 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Aug 4 20:48:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:48:23.503600 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:23.504646 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 04 20:48:23.505072 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:24.036900 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-dadaf3ab-891f-42f3-86ad-b199f8a14ddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:48:24.056160 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-dadaf3ab-891f-42f3-86ad-b199f8a14ddc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412242 Aug 04 20:48:24.056738 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Aug 4 20:48:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:48:25.047543 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:25.048568 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 04 20:48:25.048964 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:25.576347 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-b50258d9-e2e5-4da2-abb0-87d019fb5b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:48:25.595569 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-b50258d9-e2e5-4da2-abb0-87d019fb5b44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409724 Aug 04 20:48:25.596134 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Aug 4 20:48:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:48:26.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:26.563077 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Aug 04 20:48:26.563463 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:27.085380 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-809c428e-3959-482e-b6a6-c9471eff5b0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:48:27.103993 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-809c428e-3959-482e-b6a6-c9471eff5b0d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401782 Aug 04 20:48:27.104604 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Aug 4 20:48:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:48:28.197154 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:28.198396 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 04 20:48:28.198888 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:48:28.738670 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-1df12154-e543-4aef-ace1-9441dc526785 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:48:28.759628 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-1df12154-e543-4aef-ace1-9441dc526785 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415302 Aug 04 20:48:28.760100 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Aug 4 20:48:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:49:20.983727 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:20.984774 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-6f32d1d9-1a12-490e-a5b9-6da57a1e0fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 04 20:49:20.985168 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 931 bytes} [Thu Aug 4 20:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:49:20.996884 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:21.391232 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-056e2fe5-8661-40fb-8ac6-5d6dd86bfc16 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:21.412626 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-056e2fe5-8661-40fb-8ac6-5d6dd86bfc16 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420261 Aug 04 20:49:21.413123 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Aug 4 20:49:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:49:21.434268 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG dbcounter [-] [109882] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:21.438271 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-96dc23b8-2a99-4888-987b-7c5169bb445c admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:21.447401 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-96dc23b8-2a99-4888-987b-7c5169bb445c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014558 Aug 04 20:49:21.447917 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1283 bytes} [Thu Aug 4 20:49:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:49:21.459494 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-05d9012a-cc83-4ae2-97eb-d11eddefde53 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:21.467182 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-05d9012a-cc83-4ae2-97eb-d11eddefde53 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011264 Aug 04 20:49:21.467685 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1286 bytes} [Thu Aug 4 20:49:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:49:21.479770 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:21.488857 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012321 Aug 04 20:49:21.489385 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1286 bytes} [Thu Aug 4 20:49:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:49:21.501146 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-f77d3980-3538-48d5-8056-f21f027e5e77 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:49:21.509567 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-f77d3980-3538-48d5-8056-f21f027e5e77 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012261 Aug 04 20:49:21.510124 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1283 bytes} [Thu Aug 4 20:49:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:52:24.160269 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:24.161315 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 20:52:24.161710 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:52:24.306482 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=6 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:24.470093 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:24.472431 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:52:24.472431 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:52:24.473544 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:24.474021 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:24.474447 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:24.475160 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:24.475609 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:24.476026 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:24.510043 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-56c86fbf-a774-4cc1-b76f-2a31fe0c6b41 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205021 Aug 04 20:52:24.510610 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:52:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:52:25.343241 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:25.344433 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 04 20:52:25.344589 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:52:25.547638 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:25.550317 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:52:25.550317 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:52:25.551417 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:25.551897 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:25.552325 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:25.553071 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:25.553781 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:25.553948 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:25.574437 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-888f3408-36a3-4939-8d82-5801d0bac6ac admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091772 Aug 04 20:52:25.574987 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:52:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:52:36.947798 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:36.948838 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 20:52:36.949237 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:52:37.102574 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:37.103306 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell1:SELECT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:37.104080 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=8 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:37.157913 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:37.160293 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:52:37.160293 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:52:37.161601 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:37.162069 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:37.162488 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:37.163193 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:37.163631 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:37.164042 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:37.189585 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-46adcb62-ae6f-4f44-89b9-ef1606f3a317 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091449 Aug 04 20:52:37.190143 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:52:37 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:52:38.042921 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: DEBUG nova.api.openstack.wsgi [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] Calling method '>' {{(pid=109882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:38.043920 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: INFO nova.api.openstack.requestlog [None req-0f9f5c69-f616-4349-a9d1-531c098b5b83 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 04 20:52:38.044705 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: [pid: 109882|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Aug 4 20:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:52:38.242325 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:52:38.244750 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:52:38.244750 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 04 20:52:38.245877 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:38.246350 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:38.246777 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:38.248216 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:52:38.248690 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:52:38.249108 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:52:38.271067 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-0c058b6a-b0fd-4df0-b61b-663e9d0d74e2 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082289 Aug 04 20:52:38.271627 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Aug 4 20:52:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:53:37.421151 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: Thu Aug 4 20:53:37 2022 - graceful shutdown triggered... Aug 04 20:53:37.421238 dv-cinder-836027-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 20:53:37.422207 dv-cinder-836027-4-iscsi devstack@n-api.service[109881]: Gracefully killing worker 1 (pid: 109881)... Aug 04 20:53:37.422802 dv-cinder-836027-4-iscsi devstack@n-api.service[109882]: Gracefully killing worker 2 (pid: 109882)... Aug 04 20:53:38.422256 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: worker 1 buried after 1 seconds Aug 04 20:53:38.422733 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: worker 2 buried after 1 seconds Aug 04 20:53:38.422733 dv-cinder-836027-4-iscsi devstack@n-api.service[109880]: goodbye to uWSGI. Aug 04 20:53:38.423867 dv-cinder-836027-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 20:53:38.424457 dv-cinder-836027-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 20:53:38.427612 dv-cinder-836027-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 20:53:38.441410 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 20:53:38 2022] *** Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: nodename: dv-cinder-836027-4-iscsi Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: machine: x86_64 Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: clock source: unix Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: pcre jit disabled Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: detected number of CPU cores: 4 Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: current working directory: / Aug 04 20:53:38.444353 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: detected binary path: /usr/bin/uwsgi-core Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: your processes number limit is 47680 Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: your memory page size is 4096 bytes Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: detected max file descriptor number: 2048 Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: lock engine: pthread robust mutexes Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: thunder lock: enabled Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 20:53:38.445176 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 20:53:38.487125 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: Python main interpreter initialized at 0x55f0c450a9c0 Aug 04 20:53:38.487125 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: python threads support enabled Aug 04 20:53:38.487125 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: your server socket listen backlog is limited to 100 connections Aug 04 20:53:38.487125 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: your mercy for graceful operations on workers is 90 seconds Aug 04 20:53:38.487589 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 20:53:38.487589 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: *** Operational MODE: preforking *** Aug 04 20:53:38.487879 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: *** uWSGI is running in multiple interpreter mode *** Aug 04 20:53:38.487879 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: spawned uWSGI master process (pid: 124332) Aug 04 20:53:38.488054 dv-cinder-836027-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 20:53:38.489010 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: spawned uWSGI worker 1 (pid: 124350, cores: 1) Aug 04 20:53:38.489261 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: spawned uWSGI worker 2 (pid: 124352, cores: 1) Aug 04 20:53:38.489357 dv-cinder-836027-4-iscsi devstack@n-api.service[124332]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 20:53:39.166321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 20:53:39.192014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 20:53:40.396974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:53:40.396974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: from cryptography.utils import int_from_bytes Aug 04 20:53:40.397623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:53:40.397623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: from cryptography.utils import int_from_bytes Aug 04 20:53:40.406531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:53:40.406531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes Aug 04 20:53:40.407454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:53:40.407454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes Aug 04 20:53:42.842428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:53:42.842994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:53:42.843363 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:53:42.843566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:53:42.843749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:53:42.844143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.844499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.844826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.845154 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.845489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.845803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.846128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.846462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.846816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.847088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.847403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.847733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-4-iscsi {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.848058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.848391 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.848713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.849038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.849375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.849729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.850063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.850569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.852939 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.853254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.853566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.853895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.854206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.854616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-4-iscsi {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.854945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.855248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.855571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.856590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.856907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.857333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.857666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.857988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.858325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.858728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.859063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.859414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.859742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.860051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.860408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.860732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.861058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.861371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.861682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.861936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.862247 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.862572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.862899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.863226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.863486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.863742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.864067 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.864426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.864729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.865042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.866891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.867262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.867665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.867995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.868410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.868788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.869257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.869516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.869877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.870233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.870558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.870873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.871230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.871628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.872574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.873000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.873446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.873800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.874133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.874445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.874703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.875026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.875341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.875665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.875980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.876291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.876753 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.877080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.877288 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.877603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.877918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.878304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.878534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.878844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.879170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.879473 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.879781 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.880122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.880498 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.880780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.881089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.881398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.881708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.882030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.882340 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.882649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.882974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.883911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.883911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.884757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.884757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.884757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.885078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.885362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.885675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.886001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.886317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.886634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.886943 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.887297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.887704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.888285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.888285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.888536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.888842 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.889167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.889496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.889812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.890124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.890433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.890761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.891102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.891442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.891792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.892111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.892540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.892882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.893208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.893525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.893844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.894173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.894488 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.894828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.895145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.895468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.895789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.896125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.896470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.896796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.897118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.897457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.897780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.898113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.898440 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.898755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.899098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.899650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.899773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.900083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.900434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.900754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.901070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.901382 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.901706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.902044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.902361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.902685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.903588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.904177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.904177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.904516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.904808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.905151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.905470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.905980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.906300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.906628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.906950 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.907289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.907614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.907947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.908257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.908598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.908941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.909275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.909603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.909940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.910273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.910612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.910921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.911240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.911564 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.911876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.912185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.912539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.912855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.913166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.913580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.913895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.914212 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.914542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.914855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.915162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.915667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.915890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.916101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.916444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.916777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.917110 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.917442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.917793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.918109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.918499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.919485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.919822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.920156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.920513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.920827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.921146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.921457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.921770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.922081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.922395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.922703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.923022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.923350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.923659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.923968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.924301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.924662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.924996 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.925562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.925871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.926229 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.926553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.926939 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.927446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.927837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.927837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.928610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.928610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.929460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.929460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.929460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.929912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.930067 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.930321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.930648 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.930967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.931297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.931649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.931946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.932257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.932608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.932956 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.933297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.933621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.933948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.934725 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.934967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.935130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.935456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.935780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.936097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.936448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.936770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.937103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.937419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.937772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.938090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.938417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.938729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.939051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.939385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.939722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.940038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.940789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.940789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.941089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.941343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.941661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.942164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.942480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.942798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.943121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.943439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.943756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.944069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.944411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.944730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.945040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.945348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.945665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.946017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.946359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.946710 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.947045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.947448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.947686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.948015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.948332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.948662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.948981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.949302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.949686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.950013 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.950324 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.950763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.950969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.951285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.951606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.951920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.952236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.952590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.952909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.953223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.953540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.953856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.954177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.954515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.954864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.955200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.955515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.955831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.956143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.956482 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.956814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.957406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.960361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.961157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.961157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.961157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.961401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.961491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.962402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.962402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.962402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.964884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.965024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.965959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.966357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.966681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.967047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.967481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.967854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.968204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.968572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.968890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.969233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.969695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.970157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.970436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.970847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.971169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.971480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.971797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.972118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.972456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.972769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.973088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.973405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.973722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.974043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.974353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.974475 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:53:42.974921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.975014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:53:42.975095 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.975264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:53:42.975642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.975642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.975968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:53:42.975968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:53:42.976418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.976418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.976749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.976884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.977027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.977162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.977162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.977447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.984526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.984627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.984720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.984810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.984810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.984953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985199 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.985909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.985985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-4-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.986135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.986292 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.986619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.986823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.986981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987053 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987577 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.987917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.987988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988070 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.988151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.988322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.988493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.988720 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.988879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.988949 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-4-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.989872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.989961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.990044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.990133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.990223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.990316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.990407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.991003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.991104 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.991178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.991449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.991556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.991695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.991782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.991886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.991961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.992041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.992114 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.992192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.992192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.992380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.992487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.992593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.992709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.992842 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.992939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.993022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.993093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.993177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.993249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.993318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.993387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.993616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.993772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.993924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.994019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.994244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.994409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.994569 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.994723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.994891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.995050 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.995180 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.995330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.995507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.995651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.995782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.995989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.996144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.996296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.996590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.997213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.997934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.998117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.998233 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.998341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.998472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.998614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.998755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.998886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.999023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.999162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.999329 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.999480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.999637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:42.999788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:42.999981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.000167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.000351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.000512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.000693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.001184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.001353 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.001514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.001665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.001821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.001981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.002203 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.002359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.002519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.002669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.002818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.003010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.003165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.003333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.003494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.003644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.003801 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.003960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.004118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.004275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.004468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.004629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.004788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.004937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.005087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.005249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.005409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.005565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.005721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.005877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.006035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.006198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.006198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.006531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.006679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.006826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.006974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.007132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.007294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.007442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.007597 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.007754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.007903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.008066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.008222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.008435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.008604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.008762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.008920 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.009077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.009228 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.009387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.009543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.009691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.009848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.009996 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.010144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.010292 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.010488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.010645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.010807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.010985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.011188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.011351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.011525 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.011525 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.011828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.011979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.012134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.012956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013247 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013491 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013793 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.013871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.013963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.014144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.014321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014415 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.014508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.014677 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.014878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.014973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.015059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.015164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.015294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.015468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.015633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.015794 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.015955 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.016105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.016261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.016453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.016620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.016771 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.016919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.017066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.017214 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.017394 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.017561 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.017722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.017872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.018029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.018186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.018343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.018562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.018734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.018904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.019066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.019244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.019407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.019559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.019717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.019867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.020015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.020163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.020321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.020607 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.020769 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.020918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.021081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:53:43.021240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.021440 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.021600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.021759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.021910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022376 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022719 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.022872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023766 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.023928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.024863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025340 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.025943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.026740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027054 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027054 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027347 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027347 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.027835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.028660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.028833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.028833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.028833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.028833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.029492 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.029646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.029803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.029961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.030885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.031852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.032019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.032019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.032019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.032721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.032880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033349 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.033893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.034872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035347 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035647 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.035961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036271 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036456 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.036905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037136 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.037930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.038873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039024 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039640 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.039963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.040119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.040278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.040450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.040598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.041433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.041610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.041773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.042898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.043204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.043204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.043528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.043901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.044974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045766 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.045937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.046243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.046395 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.046553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.046714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.046867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.047876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.048847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.049960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.050372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.050540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.050700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.050896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.051869 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052021 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.052939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.053938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.054892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.055051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.055279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.055530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.055781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056274 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056472 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.056930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057252 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.057911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.058867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.059027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.059682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.059842 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.060885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.061982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062299 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.062929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.063860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064226 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.064885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.065939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.066931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.067907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068067 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068583 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.068898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069050 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069765 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.069915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070235 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.071953 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.072914 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.073863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.074080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.074253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.074416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.074575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.075322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.075484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.075646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.075800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.075963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.076187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.076395 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.076556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.076722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.076876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077036 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077188 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077652 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.077962 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.078902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079203 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.079962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.080986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081466 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081780 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.081940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082564 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082727 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.082887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.083899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084271 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.084960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.085756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.086844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087307 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.087924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088596 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.088901 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.089990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.090154 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.090348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.090620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.090841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.091967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.092894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093348 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.093977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094144 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094509 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.094980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.095919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096070 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.096885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.097854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098482 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.098969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.099952 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100114 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100266 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.100931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.101856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102484 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.102968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103780 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.103948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104267 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.104967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105292 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.105957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.106123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.106311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.106537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.106696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.106857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107194 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.107990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.108950 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.109900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.110987 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.111958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112491 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.112971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.113928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114776 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.114935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.115777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.116894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.117850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.118953 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119461 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.119944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.120990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.121145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.121298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.121460 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.122284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.123448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.124754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.126563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.127579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.127579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.127579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.128001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.128165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.129249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.129249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.129249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.129736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.129736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.131555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.133933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.134417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.134417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.135147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.135147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.135448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.135742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.136057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.136408 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.136814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.137059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.137930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.138251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.139758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.139758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.139758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.139758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.140427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.140427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.140427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.140904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.141063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.141375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.141809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.142133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.142446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.142771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.143322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.143322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.143322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.151090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.152269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.153514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.154646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.155751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.156790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.156790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.156790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.157237 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.157237 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.157523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.157773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.158084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.158394 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.158702 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.159009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.159360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.160786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.160786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.160786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.160786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.161884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.161884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.161884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.161884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.162486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.162486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.162777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.163083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.163400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.163716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.164034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.164655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.164996 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.165319 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.165638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.165956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.166275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.166591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.166906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.167222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.167536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.167850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.168189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.168650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.168997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.169344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.169716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.170720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.170720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.170720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.171460 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.171460 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.171784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.171932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.172180 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.172549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.172869 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.173244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.173496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.173815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.174132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.174446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.174763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.175332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.175667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.176010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.176375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.176681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.177033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.177303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.177881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.178200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.178536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.178863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.179185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.179503 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.179827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.180896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.180896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.180896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.181718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.181718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.181718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.182140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.182297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.182602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.182921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.183586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.183813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.184709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.185414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.185414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.185781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.186102 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.186413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.186745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.187037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.187343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.187661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.187974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.188279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.188617 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.188932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.189241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.189546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.189874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.190166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.191163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.191163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.191163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.191926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.191926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.192216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.192422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.192613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.192874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.193190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.193494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.193804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.194112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.194426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.194733 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.195166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.195351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.195671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.195983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.196367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.196692 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.197004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.197328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.197642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.197956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.198310 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.198631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.199226 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.199566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.200149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.201405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.201405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.201405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.202201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.202201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.202201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.202635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.202783 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.203085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.203400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.203714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.204027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.204382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.204705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.205018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.205328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.205641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.205953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.206267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.206578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.206898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.207250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.207574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.207894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.208213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.208576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.208889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.209199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.209513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.209822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.210140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.210472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.210861 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.211798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.211798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.211798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.212600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.212600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.212897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.213058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.213363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.213674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.213994 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.214307 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.214638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.214979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.215826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.216161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.216510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.216822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.217130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.217443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.217763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.218074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.218379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.218683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.218992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.219304 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.219612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.219913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.220224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.220573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.220905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.221177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.221561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.221979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.222155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.222487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.222656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.222965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.223272 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.223579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.223886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.224191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.224548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.224882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.225199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.225522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.225834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.226147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.226454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.226777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.227098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.227757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.227931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.228184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.228538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.228857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.229172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.229486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.229797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.230115 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.230449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.230777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.231792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.232246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.232549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.232831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.232995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.233291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.233624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.233937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.234250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.234562 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.234875 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.235189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.235508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.235820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.236134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.236534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.236792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.237122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.237450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.237763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.238093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.238421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.238771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.239086 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.239432 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.240225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.240225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.240605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.240754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:53:43.240931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:53:43.277387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO dbcounter [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Registered counter for database nova_api Aug 04 20:53:43.301980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.310406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writer thread running {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.369941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.context [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc954cb4-bb24-40a9-85b5-b62168d68e97(cell1) {{(pid=124352) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 20:53:43.374306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:53:43.374792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:53:43.376411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:53:43.377354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:53:43.377823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:53:43.379826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:53:43.381970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO dbcounter [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Registered counter for database nova_cell0 Aug 04 20:53:43.386336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO dbcounter [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Registered counter for database nova_cell1 Aug 04 20:53:43.394499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.395226 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Registered counter for database nova_api Aug 04 20:53:43.395930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.410682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writer thread running {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.415860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.417528 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writer thread running {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.422785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.480495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.context [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc954cb4-bb24-40a9-85b5-b62168d68e97(cell1) {{(pid=124350) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 20:53:43.484760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:53:43.485246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:53:43.486830 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:53:43.487554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:53:43.488035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:53:43.490012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:53:43.492033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Registered counter for database nova_cell0 Aug 04 20:53:43.496232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Registered counter for database nova_cell1 Aug 04 20:53:43.503851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.505278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.511512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.517933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.572001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO dbcounter [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Registered counter for database nova_cell0 Aug 04 20:53:43.580025 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.584516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writer thread running {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.663490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Registered counter for database nova_cell0 Aug 04 20:53:43.670331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:53:43.674773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:53:43.920578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: WARNING keystonemiddleware.auth_token [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:53:43.928224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: WARNING keystonemiddleware.auth_token [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:53:43.993558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:53:44.001513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:53:44.283232 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: WARNING keystonemiddleware.auth_token [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:53:44.289531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: WARNING keystonemiddleware.auth_token [None req-e6a54ca3-c95a-4314-9e33-ecf7ebd6a84d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:53:44.296758 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0c450a9c0 pid: 124352 (default app) Aug 04 20:53:44.344134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 20:53:44.350185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-f889581a-3cac-44af-8f32-b145d8dc6e08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 20:53:44.357107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0c450a9c0 pid: 124350 (default app) Aug 04 20:54:22.864865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:22.865703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:22.866621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:22.867754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:23.243454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-be410b6c-5f0f-4748-bbeb-3cca4f1958fe tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc845ca0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:23.686084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-be410b6c-5f0f-4748-bbeb-3cca4f1958fe tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8e758048-69f8-4039-9427-91bd07b84917" status: 200 len: 351 microversion: 2.1 time: 0.830736 Aug 04 20:54:23.686678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 20:54:22 2022] GET /compute/v2.1/os-volumes/8e758048-69f8-4039-9427-91bd07b84917 => generated 351 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:25.843825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e7bc5f1-b25e-440d-8542-a66b9761ee74 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc8c5940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:25.880146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:25.881455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:25.882622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:25.883573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:26.273021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e7bc5f1-b25e-440d-8542-a66b9761ee74 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/205654bf-e9aa-4985-831f-bb9f4bb36203" status: 200 len: 351 microversion: 2.1 time: 0.788544 Aug 04 20:54:26.273609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 20:54:25 2022] GET /compute/v2.1/os-volumes/205654bf-e9aa-4985-831f-bb9f4bb36203 => generated 351 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:31.921368 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c051b2d7-b2f8-4a96-bf02-1c0483fef10f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: .version_select at 0x7f2bdc7493a0>, body: {"keypair": {"name": "tempest-keypair-766320930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkDRnB5R9ATIBtntjmmsD0kWo9ZymHsl7GZQCgrVwJUr/sO0ZJziUju8KZa2OwNLiTnqpY4tKJIrRdURMMQdcWDUuOlyamwqL7B9GTllhlvLrQw6OMSZveMGC1ep1OYbQ=="}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:31.979970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-c051b2d7-b2f8-4a96-bf02-1c0483fef10f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:32.002033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-c051b2d7-b2f8-4a96-bf02-1c0483fef10f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for user 87929879b1c74efea0a390a3ce1a4006 and project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:32.101799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c051b2d7-b2f8-4a96-bf02-1c0483fef10f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.274203 Aug 04 20:54:32.113298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:54:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:33.801584 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-68714271-ad02-483f-b988-d8b484b9e211 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc717c10>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:33.953211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-68714271-ad02-483f-b988-d8b484b9e211 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d5db33ae-8cf2-46eb-8640-0c3172c6304c" status: 200 len: 351 microversion: 2.1 time: 0.169586 Aug 04 20:54:33.954603 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 20:54:33 2022] GET /compute/v2.1/os-volumes/d5db33ae-8cf2-46eb-8640-0c3172c6304c => generated 351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:33.983010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e66b4122-20cd-43e6-ba26-ab9097eb82cc tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc6695e0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:34.235224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e66b4122-20cd-43e6-ba26-ab9097eb82cc tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.271322 Aug 04 20:54:34.237607 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1134 bytes} [Thu Aug 4 20:54:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:34.266690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d78cdc8-85a2-476d-8bab-b0f076426c09 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc717dc0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:34.440105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d78cdc8-85a2-476d-8bab-b0f076426c09 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.189293 Aug 04 20:54:34.440956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1149 bytes} [Thu Aug 4 20:54:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:34.474242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9fec66ea-c10a-4f7e-98e3-8a2ce5d69c3b tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc6a6e50>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:34.664837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9fec66ea-c10a-4f7e-98e3-8a2ce5d69c3b tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.205345 Aug 04 20:54:34.665423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1134 bytes} [Thu Aug 4 20:54:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:34.679627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f7471b5-765d-4ba4-a6f0-93fc7f74b2c1 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc717820>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:34.846835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f7471b5-765d-4ba4-a6f0-93fc7f74b2c1 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.171088 Aug 04 20:54:34.847889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1167 bytes} [Thu Aug 4 20:54:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:34.871436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f5a16a77-cb4f-4562-91a9-f2a86d779c42 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc65c550>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:35.029305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f5a16a77-cb4f-4562-91a9-f2a86d779c42 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164649 Aug 04 20:54:35.034125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1170 bytes} [Thu Aug 4 20:54:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:35.049467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1ad87542-5808-4978-b96e-afa6a96496ac tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc666e50>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:35.256895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1ad87542-5808-4978-b96e-afa6a96496ac tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.211279 Aug 04 20:54:35.258196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1155 bytes} [Thu Aug 4 20:54:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:35.276084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-407e9527-f9a3-4642-8510-8cf0db8aa940 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc65c700>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:35.497871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-407e9527-f9a3-4642-8510-8cf0db8aa940 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.228204 Aug 04 20:54:35.506776 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1188 bytes} [Thu Aug 4 20:54:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:35.515084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-28d019c8-5468-4163-92a4-e8fbe163e529 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] Calling method '.version_select at 0x7f2bdc6830d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:35.811620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-28d019c8-5468-4163-92a4-e8fbe163e529 tempest-VolumesTestJSON-1961165699 tempest-VolumesTestJSON-1961165699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.303222 Aug 04 20:54:35.813417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1155 bytes} [Thu Aug 4 20:54:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:36.871265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1521557054", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e9fd9f1-fbc3-4312-8e1c-f673ea000928"}], "security_groups": [{"name": "tempest-securitygroup--5288082"}], "key_name": "tempest-keypair-766320930", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:37.125723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] validate_networks() for [('4e9fd9f1-fbc3-4312-8e1c-f673ea000928', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:38.439261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:38.439854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:38.440869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:38.441365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:38.441984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:38.470081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:38.470965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:38.472739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:38.475796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:38.480776 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:38.481432 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:38.565000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:38.577865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for user 87929879b1c74efea0a390a3ce1a4006 and project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:38.607138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:38.613609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:38.795800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b662e5ec-54dc-4cad-908c-ac4cd48d45c4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.930945 Aug 04 20:54:38.815529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 7/13] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:54:36 2022] POST /compute/v2.1/servers => generated 399 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:54:38.824444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bf5ac3ba-c880-4db2-b85d-8c6e7848794e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:38.825385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bf5ac3ba-c880-4db2-b85d-8c6e7848794e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:39.080852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bf5ac3ba-c880-4db2-b85d-8c6e7848794e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:39.107304 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bf5ac3ba-c880-4db2-b85d-8c6e7848794e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1237 microversion: 2.1 time: 0.290020 Aug 04 20:54:39.113175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:38 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1237 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:40.019291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-78e2614b-f927-47a2-80f4-052248adfd6b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: .version_select at 0x7f2bdbd441f0>, body: {"keypair": {"name": "tempest-keypair-1902644149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGh0q9fB71G1bWj1S/BG+q+fdI4Zqq0ZuMBIw3ZQWlJTpqtoQX6YVBU6dK9OLuuddSjJym+FsgVC9P7hhJBpkIqgaKcpoQgRbUcd189xRPK6D6kOTtArh6yJLgXoMwsvA=="}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:40.097797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-78e2614b-f927-47a2-80f4-052248adfd6b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:40.125799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-78e2614b-f927-47a2-80f4-052248adfd6b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for user a1930e444b5b47ea8e606c7ee4da600f and project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:40.146797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0d7f7452-c643-4153-a903-8840fe354d43 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:40.147836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0d7f7452-c643-4153-a903-8840fe354d43 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:40.216863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-78e2614b-f927-47a2-80f4-052248adfd6b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.357448 Aug 04 20:54:40.231204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 8/15] 10.222.0.52 () {62 vars in 1200 bytes} [Thu Aug 4 20:54:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 373 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 20:54:40.436150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0d7f7452-c643-4153-a903-8840fe354d43 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:40.452514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0d7f7452-c643-4153-a903-8840fe354d43 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1237 microversion: 2.1 time: 0.300862 Aug 04 20:54:40.453171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:40 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1237 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:41.652753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e238ea19-a930-4fb9-82be-41d132c36a57 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: .version_select at 0x7f2bdc8c5940>, body: {"keypair": {"name": "tempest-keypair-873855433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn94nzAPnUm03h6KpwUrLf9Llgaax9f0z/H5CKUOTF0Q+XLJFulvANXoQbiSur0ZJMjqh8dMc/HmF5PwUwklsCm8+Fo+m+BeiuJpl8aiX1MoKbfyfbndQ2dpAzoFyE/MQ=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:41.719899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2030862011", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:41.789755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e238ea19-a930-4fb9-82be-41d132c36a57 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:41.813635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e238ea19-a930-4fb9-82be-41d132c36a57 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:41.857293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] validate_networks() for [('8cc3f9ac-fe82-4e5a-bf74-470365985e49', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:41.987231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e238ea19-a930-4fb9-82be-41d132c36a57 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.575388 Aug 04 20:54:41.988224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 9/17] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:54:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:42.001236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:42.005249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:42.023906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:42.025453 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:42.028600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:42.029612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:42.030239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:42.033626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:42.412375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:42.438576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-50e3f91e-ea91-4ea6-a092-f46d43956efc tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1233 microversion: 2.1 time: 0.449057 Aug 04 20:54:42.445355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 10/18] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:41 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1233 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:42.619713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-436402725", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "networks": [{"uuid": "d4abfdf4-9744-439e-adf3-3ee6fd843df0"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:42.820382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] validate_networks() for [('d4abfdf4-9744-439e-adf3-3ee6fd843df0', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:43.514107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:43.514683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:43.515265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:43.515773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:43.516285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:43.538471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:43.538885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:43.539317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:43.540034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:43.541570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:43.544012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:43.581387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:43.588770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for user 5026c90f0e3d49669c335ef542280409 and project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:43.603119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:43.606901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:43.693788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2ef0ef11-a0d9-4d11-b266-dff4ddcc1629 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.335086 Aug 04 20:54:43.695712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 9/19] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:54:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:54:43.710656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:43.712747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:43.743265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:43.750919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:43.751792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:43.752800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:43.753776 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:43.755227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:44.379737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:44.410396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f6c3eb71-a68b-4fbf-abd3-734f24cb2bdf tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1295 microversion: 2.1 time: 0.709409 Aug 04 20:54:44.410396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 10/20] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:43 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1295 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:44.417737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1b4c1481-57cd-46b4-b42f-a32e873bbca1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:44.423631 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1b4c1481-57cd-46b4-b42f-a32e873bbca1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:44.581843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1b4c1481-57cd-46b4-b42f-a32e873bbca1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:44.634132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1b4c1481-57cd-46b4-b42f-a32e873bbca1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1222 microversion: 2.1 time: 0.220900 Aug 04 20:54:44.635965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:44 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:45.158161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-589295863", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:45.316760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] validate_networks() for [('8cc3f9ac-fe82-4e5a-bf74-470365985e49', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:47.394739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:47.395341 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:47.395707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:47.396246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:47.396743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:47.440477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:47.441008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:47.441453 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:47.442204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:47.442725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:47.443080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:47.544898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Getting quotas for project 281963666cbf4245a97cbb213a3fa0e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:47.553425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Getting quotas for user cfdbada2f1a74976b42d299a813335cf and project 281963666cbf4245a97cbb213a3fa0e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:47.600891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:47.610184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:47.798272 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e27f7ac3-cbec-4cad-ba2a-351780db5d4b tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.351477 Aug 04 20:54:47.799572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 11/22] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:54:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 5353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:54:47.805164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:47.806554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:47.827699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:47.836827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:47.841118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:47.846921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:47.858980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:47.861127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:49.018791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:49.035052 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3c49caeb-4abb-41df-9904-ac85bc324c8d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 1.233429 Aug 04 20:54:49.035703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:47 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:49.044417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-981fbd22-d33c-48c0-be61-6b848dce5d1c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:49.054476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-981fbd22-d33c-48c0-be61-6b848dce5d1c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:49.411957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-981fbd22-d33c-48c0-be61-6b848dce5d1c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:49.435983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-981fbd22-d33c-48c0-be61-6b848dce5d1c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1214 microversion: 2.1 time: 0.398757 Aug 04 20:54:49.448379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 13/24] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:49 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1214 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:49.562933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1475025533", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f888fc91-7d8c-4649-9bc4-c28566886ae4"}], "security_groups": [{"name": "tempest-securitygroup--2051572647"}], "key_name": "tempest-keypair-1902644149", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:50.112845 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:50.114617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:50.115198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:50.115816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:50.116424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:50.155185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:50.160758 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:50.162925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:50.165589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:50.166916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:50.171569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:50.282791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:50.301390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for user 5026c90f0e3d49669c335ef542280409 and project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:50.345730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:50.348080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:50.548670 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] validate_networks() for [('f888fc91-7d8c-4649-9bc4-c28566886ae4', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:50.574459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-00f4c370-547d-4eff-9542-0ac00e5bcbf6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.426842 Aug 04 20:54:50.584506 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 12/25] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:54:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 5434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:54:50.598479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:50.598479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:50.612171 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:50.612898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:50.613416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:50.614174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:50.614638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:50.615062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:52.018466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:52.029186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a81e65dd-d5fc-4999-8707-7b75c2b09137 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 1.443407 Aug 04 20:54:52.036355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 13/26] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:50 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:52.062757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:52.068777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:52.102919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:52.103794 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:52.104867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:52.114784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:52.116664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:52.117579 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:52.694687 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:52.704835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c971b312-a2cb-43dc-a6d3-523aa4050720 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1272 microversion: 2.1 time: 0.666782 Aug 04 20:54:52.716694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:52 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1272 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:52.716694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:52.716694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:52.755275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:52.756143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:52.757125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:52.758131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:52.761164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:52.761998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:54.018531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:54.030490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-17715b87-3aa5-4b92-b141-b2749ee9f892 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1273 microversion: 2.1 time: 1.320318 Aug 04 20:54:54.038697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:52 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1273 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:54.057417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-11561034", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fc90a20-030f-4833-b078-8e1884210eeb"}], "security_groups": [{"name": "tempest-securitygroup--863811083"}], "key_name": "tempest-keypair-873855433", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:54.108685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=11 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:55.029530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:55.031826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:55.038870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:55.039584 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:55.040165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:55.063295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.064812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.069587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.070436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.070924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.071370 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.115157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:55.122207 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for user a1930e444b5b47ea8e606c7ee4da600f and project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:55.155495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:55.161960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:55.279750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-01012740-7ac2-45c6-8ed2-115387863124 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.722972 Aug 04 20:54:55.284008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 14/29] 10.222.0.52 () {62 vars in 1188 bytes} [Thu Aug 4 20:54:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 5728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 20:54:55.706331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4eef31-8b60-4328-adde-046f701b8d15", "tag": "91c963eb-7115-4422-87fd-8a3f75efd3d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:54:55.744992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.746166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.746614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.794813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Creating event network-changed:91c963eb-7115-4422-87fd-8a3f75efd3d6 for instance cd4eef31-8b60-4328-adde-046f701b8d15 on hv-cinder-83602 Aug 04 20:54:55.795626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 20:54:55.796245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b51865-c3fa-412b-bf9c-aa86ad33b5ba req-c7f38f2b-2e23-4689-87d3-1751d3359e71 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 20:54:55.797555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.798244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.799962 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.801237 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.801771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.802362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.826850 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] validate_networks() for [('2fc90a20-030f-4833-b078-8e1884210eeb', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:54:55.843899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.compute.rpcapi [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 20:54:55.844884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] Releasing lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 20:54:55.883420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ee22f5a5-ad70-4f44-a38a-84b2066c3516 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595385 Aug 04 20:54:55.884055 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 15/30] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:54:55.899893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:55.902862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:55.943329 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.944283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.944788 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:55.946291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:55.949205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:55.949836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:56.720673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:56.728528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2fe7ee56-d21a-411e-984f-4a1025f695e6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.843092 Aug 04 20:54:56.732146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 16/31] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:55 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:56.753106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:56.757145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:56.779261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:56.785037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:56.790006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:56.791262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:56.795335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:56.796389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.141754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:54:57.149892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.150348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:54:57.150947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:54:57.151440 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:54:57.154747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:54:57.169353 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0c58df9c-0b92-45f6-8ea1-d2c7552649b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.419894 Aug 04 20:54:57.170717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=29 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:57.185139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 17/32] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:56 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:57.195651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.201490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.202221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.206211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:57.207100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.208240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:57.208600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.209069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.221057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.221787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.222510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.223415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.224078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.224732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.281812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:54:57.291935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:54:57.332824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:54:57.335543 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:54:57.415957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.431476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dfc6dabf-7965-4dd2-bc50-93bb2ed6f2ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1279 microversion: 2.1 time: 0.244174 Aug 04 20:54:57.435034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f542214e-31b5-4b38-88b0-18b5892a96ab tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.394335 Aug 04 20:54:57.442157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 16/33] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:54:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 3402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:54:57.445084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 18/34] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:57 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:57.460931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5054422e-1063-4e4a-b9b6-7cd9a7b0c795 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:57.461725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5054422e-1063-4e4a-b9b6-7cd9a7b0c795 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:57.463679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:57.465743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:57.484017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.485035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.485923 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.486816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.489343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.489985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.587581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5054422e-1063-4e4a-b9b6-7cd9a7b0c795 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.595597 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5054422e-1063-4e4a-b9b6-7cd9a7b0c795 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1239 microversion: 2.1 time: 0.148742 Aug 04 20:54:57.598366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:57 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:57.623174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.631283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.637728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:57.643671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-98228a3e-3460-4a88-8963-58cf5b4257ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.200153 Aug 04 20:54:57.645069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 17/36] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:54:57 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:54:57.754469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:57.755111 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:57.769319 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.770579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.772959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:57.774622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:57.776649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:57.777992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.044373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.058456 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cfa56569-8b26-4521-a4de-c5e62d25fe02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.308439 Aug 04 20:54:58.062545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 20/37] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:57 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:58.206981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:58.207793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:58.225373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.227899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.229661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.234647 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.236612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.237280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.450464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.460860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a698f707-1203-4e56-a0b0-ae72276263a0 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.265019 Aug 04 20:54:58.472989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:58.472989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:58.477317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 18/38] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:58 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:58.478209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.479374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.488083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.488959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.489454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.493108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.568650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.583411 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d087b955-5124-4fc4-942d-37b5b4bae1cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1279 microversion: 2.1 time: 0.119432 Aug 04 20:54:58.584298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 21/39] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:58 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:58.618951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:58.621172 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:58.627893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.628406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.628992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.629941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.630429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.631173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.667583 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:58.668221 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:58.674983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.675925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.676576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.677445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:58.678054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:58.678633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:58.712701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.721892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9c10926e-5f9e-494e-8b47-59e9665a363c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.106515 Aug 04 20:54:58.736154 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:58 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:58.749713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.762787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.764392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:58.765524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b74d16c7-b890-4f5d-a925-7396d42e0b7a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.102352 Aug 04 20:54:58.780724 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 22/41] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:54:58 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:54:59.083496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:59.084828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:59.094792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.095786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.096456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.097447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.098098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.098705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.396253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:59.413732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8eae6677-1676-4d8a-b09e-91c16e4fe9e3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.334100 Aug 04 20:54:59.414488 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 20/42] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:59 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:59.486646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:59.487755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:59.505019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.506510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.507819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.512881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.519721 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.519721 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.610569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:59.611598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:59.644145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.645546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.646005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.648661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.649159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.655348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.857808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:59.872823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7d4a65c0-389f-4925-9903-5ae8c81d6732 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1279 microversion: 2.1 time: 0.263783 Aug 04 20:54:59.878986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 21/43] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:59 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:54:59.888848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:54:59.892689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:54:59.910350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.918878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.920919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.924376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:54:59.925196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:54:59.926876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:54:59.943306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:54:59.954595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-91651e47-cfd7-4284-a585-c49b6db0ee42 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.471207 Aug 04 20:54:59.955523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 23/44] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:59 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:00.011688 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:00.016442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:00.029997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.031944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.032679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.033664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.034551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.035556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.199245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:00.211696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-baa0c0b0-68d1-4253-9469-23ec54d6b894 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.328464 Aug 04 20:55:00.213810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 22/45] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:54:59 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:00.238674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:00.248765 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:00.251786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:00.253741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e682d92c-0309-4695-85d7-b3d40f885396 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.281005 Aug 04 20:55:00.254498 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:54:59 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:00.436503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:00.437286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:00.443794 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.444845 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.445184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.445892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.446406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.447220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.608780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:00.620918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1aaf1153-7a54-4a6b-80ec-10da8117f594 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.188726 Aug 04 20:55:00.621791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 23/47] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:00 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:00.894678 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:00.895305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:00.901554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.902052 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.902904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.903198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.903666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.904099 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.986418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:00.987132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:00.995901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.996594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.997036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:00.997740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:00.998192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:00.998613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.127902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.139730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-651cfea2-18f1-4b38-8cbd-86d9ff984cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.248397 Aug 04 20:55:01.141130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:00 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:01.188846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.201583 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-780102a2-8ae9-47cf-8fa6-72e255360bfe tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.219404 Aug 04 20:55:01.202471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 24/49] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:00 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:01.233797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:01.234418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:01.241637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.242154 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.242626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.243410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.243873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.244386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.278626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:01.279242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:01.289859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.290559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.291224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.292233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.292874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.293401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.318094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.327658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b7543049-e9ad-43e7-9285-4df0b3da763a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.097633 Aug 04 20:55:01.328427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 26/50] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:01 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:01.388815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.396988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.398812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.406020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6802101d-8c63-4994-90dc-12e92889fd35 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.131745 Aug 04 20:55:01.406708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:01 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:01.642828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:01.643713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:01.650322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.651057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.651507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.652210 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:01.652697 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:01.653125 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:01.812003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:01.819561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-56cfcf0a-d975-41ca-8fea-8bfa34a984e2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.180583 Aug 04 20:55:01.820123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 27/52] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:01 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:02.160749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:02.161362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:02.169478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.169971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.170410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.171111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.171565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.171988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.223625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:02.224438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:02.232441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.232928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.233546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.234391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.235572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.236147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.362451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.371527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-05f815e3-e507-4674-a672-baae0e8f914c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.214470 Aug 04 20:55:02.372111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 26/53] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:02 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:02.380676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:02.381616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:02.388479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.389192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.389625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.390780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.390780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.391159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.433451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.442295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d28f37e9-9afb-4c1e-b010-26fb8935c598 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.222919 Aug 04 20:55:02.443065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 28/54] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:02 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:02.447851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:02.448834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:02.462483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.463509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.464280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.465484 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.465951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.466378 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.483318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.491062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8c868ae9-9adf-4e05-a959-99a72bd5c03a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.117890 Aug 04 20:55:02.492973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 27/55] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:02 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:02.545492 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.554191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.555697 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:02.557643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f2e5f029-a35f-421d-b726-9010540d2e8c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.112966 Aug 04 20:55:02.558237 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 29/56] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:02 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:02.841406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:02.842017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:02.848275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.848610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.849240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.849822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:02.850277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:02.850704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:02.855354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:02.997959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.006938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-68d12a90-f0c9-4d00-9ca1-5aeca0a97503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.169865 Aug 04 20:55:03.007933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 28/57] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:02 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:03.393917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:03.394545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:03.402616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.404843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.405516 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.407139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.407828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.409011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.418372 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:03.465509 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:03.466127 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:03.488821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.489661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.490331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.493368 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.497414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.505465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.708167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.718589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-35c78d2b-bcc6-4a37-b026-b5dd41a90186 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.330445 Aug 04 20:55:03.725352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 30/58] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:03 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:03.735806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:03.741398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:03.755067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.761862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.762325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.763071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.763822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.764267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.824841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.839409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d8e5863e-6cf4-44c0-93b3-b0d5461a6974 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.379709 Aug 04 20:55:03.845192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 29/59] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:03 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:03.859557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:03.860194 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:03.868755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.870885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.871925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.873176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:03.874302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:03.875437 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:03.910005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.926073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-602ea361-9763-4849-90a2-33685b801a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.198878 Aug 04 20:55:03.926661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 31/60] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:03 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:03.981527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.992429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.994777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:03.996918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-42f03d21-9564-4ab7-94a6-2af2a098a6d2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.150252 Aug 04 20:55:04.012366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 30/61] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:03 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:04.029532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:04.030145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:04.035037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:04.037869 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.038368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.038806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.044280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.044840 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.045314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.386471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:04.396033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-04c079fd-d6c1-4753-879b-21db89da0d63 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.370689 Aug 04 20:55:04.400382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 32/62] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:04 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:04.746038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:04.747059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:04.755028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.756588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.758146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.759480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.760374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.761005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.866169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:04.866788 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:04.874743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.875246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.875691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.876422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.877564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.878144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.922369 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:04.932250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-afc93d7f-d8c6-4861-9844-011e384ea661 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.190288 Aug 04 20:55:04.933197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 31/63] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:04 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:04.953429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:04.954243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:04.960656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.961352 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.961944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:04.963606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:04.964236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:04.964872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.055960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.063296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.071386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cdce7e3a-a97b-4351-8725-82f626c95f9e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.209443 Aug 04 20:55:05.071909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-aab743eb-fdd5-4169-ac2d-6808b20ce64a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1243 microversion: 2.1 time: 0.125640 Aug 04 20:55:05.072031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 33/64] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:04 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:05.074980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 32/65] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:04 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1243 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:05.077309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:05.077917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:05.083900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.084416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.084927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.085625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.086089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.086516 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.162030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.171192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.172745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.173905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1e4f5bbd-f200-4ae8-aa3b-fd77275e961d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1286 microversion: 2.20 time: 0.100434 Aug 04 20:55:05.174462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:05 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:05.425126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:05.426005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:05.432553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.432553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.433402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.434109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.434568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.434994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.571947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:05.581880 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f4655c38-5797-45b3-af55-4a69ce249fe7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.166606 Aug 04 20:55:05.582857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 33/67] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:05 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:05.960291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:05.961868 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:05.974547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:05.982014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.983309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.984978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:05.986851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:05.989994 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:05.990707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:06.094434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:06.095225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:06.115419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:06.116113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:06.116605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:06.122378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:06.122968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:06.123695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:06.918195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:06.928854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b0d9e8f-60e1-43be-96c5-ef588af3cc86 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.973561 Aug 04 20:55:06.929890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 35/68] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:05 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:06.937354 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:06.938278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:06.949580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:06.950556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:06.951290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:06.953049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:06.953829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:06.954701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:06.993985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.005933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e3072e94-1d31-4af4-bbd9-f4ac157c4dc9 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.914759 Aug 04 20:55:07.017394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:06 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:07.035938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:07.037830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:07.048401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.048889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.049320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.050026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.050732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.051150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.077059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.089874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-016b4a97-9242-461d-a443-b2c82c9fd5c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1291 microversion: 2.1 time: 0.158626 Aug 04 20:55:07.090523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 36/70] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:06 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1291 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:07.098624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:07.099805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:07.109430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.110015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.110524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.111350 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.111783 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.112448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.221652 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.240730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.250469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.256318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8ea45164-8bf8-4085-84cf-cad02c9e8ee0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1342 microversion: 2.20 time: 0.235881 Aug 04 20:55:07.258871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 35/71] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:07 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:07.523869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8cf39d-924e-44b9-a724-e9cb2d7a87be", "tag": "5eb68dbc-50ad-4339-b1ca-307285f5949b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:07.537004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=8 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:07.538431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=5 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:07.546677 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.547608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.548519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.581786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Creating event network-changed:5eb68dbc-50ad-4339-b1ca-307285f5949b for instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be on hv-cinder-83602 Aug 04 20:55:07.582589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 20:55:07.583332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-905334b4-0bfd-4085-b0d8-943104ff5764 req-b92b5c56-c7d7-4a47-b89e-8a7b8be79831 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 20:55:07.585176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.586392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.587078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.588398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.589760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.590411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.595448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=24 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:07.602276 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:07.613833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b0dc0540-987d-44a3-a44b-d83757754c83 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.521486 Aug 04 20:55:07.615074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 37/72] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:07 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:07.619242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.compute.rpcapi [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 20:55:07.620809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] Releasing lock "compute-rpcapi-router" {{(pid=124352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 20:55:07.649938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-084db465-ab45-4ed1-bd7c-d1af46a3fb3b None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135081 Aug 04 20:55:07.652457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 36/73] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:55:07.886320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e24f4b7-a043-4e4c-b890-8afc32c415f2", "tag": "f74916b5-02e1-46c5-8888-6a70ea5a98aa"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:07.899574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.900117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.901767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.915043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] Creating event network-changed:f74916b5-02e1-46c5-8888-6a70ea5a98aa for instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 on hv-cinder-83602 Aug 04 20:55:07.921272 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-1e54b14f-9ecf-48a5-ad2e-9212fecb73db req-f8e2b9ea-5d47-4ad5-8d21-1ec7e4171868 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124651 Aug 04 20:55:07.922270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 38/74] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:07.959361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:07.960699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:07.970940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.971528 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.972098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:07.973008 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:07.973474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:07.973995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.034336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:08.035054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:08.047966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.048482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.048926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.049642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.050095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.050785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.214668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.226156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fc63871d-0998-49d1-b37d-7064cb8868db tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.272875 Aug 04 20:55:08.227537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 37/75] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:07 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:08.253038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:08.253707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:08.266915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.267821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.268962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.270638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.271384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.272071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.301213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.310500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8a0f3160-dd3b-40ca-94dd-f2d703d24ca1 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.282100 Aug 04 20:55:08.321136 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:08 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:08.332215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:08.333513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:08.341455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.342331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.342974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.344032 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.345002 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.345543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.363562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.372578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ff47a6b6-577d-4568-aa0d-1d0b48d673c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1299 microversion: 2.1 time: 0.142607 Aug 04 20:55:08.374865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 38/77] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:08 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:08.434201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.443312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.444911 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.446028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e2019f2-5f1b-4469-9c53-53a4f884c0c4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1352 microversion: 2.20 time: 0.123688 Aug 04 20:55:08.446951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 40/78] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:08 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:08.637134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:08.637911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:08.644324 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.644935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.645380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.646071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:08.646637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:08.647059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:08.871153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:08.879709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6066dc21-c409-4dec-b78c-a6d9afe3f1d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.247946 Aug 04 20:55:08.880821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 39/79] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:08 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:09.253420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:09.254614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:09.265969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.267767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.270365 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.273698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.275977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.278167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.333577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:09.334471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:09.342939 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.343621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.344121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.345102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.345716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.346274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.586534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.599068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c167154d-3fff-4364-b01b-d12b26dc3fec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.353423 Aug 04 20:55:09.601130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 41/80] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:09 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:09.608915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:09.610251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:09.617909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.618709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.620265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.621607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.622778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.623451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.662841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.673464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ba50cc8d-c833-47d1-8ece-3a1130a8b138 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.344282 Aug 04 20:55:09.674062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 40/81] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:09 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:09.680317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:09.680956 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:09.689902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.690514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.691076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.692128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.692701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.693252 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.728077 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.738668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f1ca4fb-a8b0-497f-8383-571f362e79c5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1299 microversion: 2.1 time: 0.136092 Aug 04 20:55:09.739521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 42/82] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:09 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:09.832046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.866986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.872656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:09.876129 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3c04ab3f-9cb2-48c7-9aad-0390cd4a9ecc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1352 microversion: 2.20 time: 0.201006 Aug 04 20:55:09.895494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 41/83] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:09 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1352 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:09.904549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:09.909169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:09.939396 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.940933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.944531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.945964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e886a88-4224-4e56-a476-be4fd7bf6add", "tag": "cb40fc25-352d-4823-8a9a-b69b0baaaaf6"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:09.947449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.947958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.948428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.961370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:09.966846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:09.967795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:09.993814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] Creating event network-changed:cb40fc25-352d-4823-8a9a-b69b0baaaaf6 for instance 1e886a88-4224-4e56-a476-be4fd7bf6add on hv-cinder-83602 Aug 04 20:55:10.004014 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-b260e00c-3b2c-4a7d-a43f-ac8463bb8c78 req-2bf08f0e-49d7-46c5-867f-25fedea8ff20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060780 Aug 04 20:55:10.018005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 42/84] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:55:10.624580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:10.625375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:10.626172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:10.633962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:10.638213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e1dc1fcd-3ed8-4608-9bf9-310a65c0f075 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.738952 Aug 04 20:55:10.640522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:10.641088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 43/85] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:09 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:10.641205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:10.641900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:10.642378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:10.642812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:10.696153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:10.697067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:10.707151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:10.708898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:10.710109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:10.717454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:10.718427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:10.719088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:11.708391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:11.713476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:11.719351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fde5ab4b-a038-4a06-9051-08c5bae14248 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 1.026838 Aug 04 20:55:11.720869 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 44/86] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:10 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:11.722663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-85f97526-9b3b-4bfa-a368-c6bed564f4c5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 1.103744 Aug 04 20:55:11.729687 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:11.730616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 43/87] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:10 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:11.731493 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:11.735718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:11.748716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:11.748716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:11.748716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:11.748716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:11.749010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:11.749010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:11.750617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:11.764006 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:11.767008 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:11.768075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:11.771344 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:11.772102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:11.773029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.080398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:12.083475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:12.094888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90a3b32c-ee5a-4ec9-8af0-0e020c9bda9e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1297 microversion: 2.1 time: 0.370563 Aug 04 20:55:12.097058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 45/88] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:11 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1297 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:12.107044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:12.107825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:12.109980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:12.119820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:12.127405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6cd0b097-0043-420d-ac3c-47982aa7f41d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1340 microversion: 2.20 time: 0.389258 Aug 04 20:55:12.128089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 44/89] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:11 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1340 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:12.130468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.131292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.131739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.132479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.133165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.133748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.359757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:12.373541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b52b16ac-c6ad-434d-af78-3212b054ce01 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.274920 Aug 04 20:55:12.374746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 46/90] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:12 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:12.742934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:12.743544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:12.755089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.755603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.764739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:12.765375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:12.771310 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.772072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.772583 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.773016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.782563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.783067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.787908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.788781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:12.789237 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:12.793647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:12.820695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:13.114384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.125468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.133696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:13.135714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a6ce1e20-dfb0-4204-8c3d-d6ec55e25b81 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.377270 Aug 04 20:55:13.136896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 47/91] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:12 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:13.139937 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cd5e1bdb-d8a8-490e-a430-ea43368af76d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.400561 Aug 04 20:55:13.140847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 45/92] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:12 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:13.143549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:13.146096 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:13.153468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.153952 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.154382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.155347 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.156272 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.156724 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.170430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:13.170430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:13.203328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.203845 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.204297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.205037 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.205493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.205919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.427631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.439688 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-98815ef4-6195-48e3-a948-846f20c9b688 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.300575 Aug 04 20:55:13.440643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 48/93] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:13 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:13.457489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:13.458725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:13.459291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.468408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.468625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.469163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.470452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.470694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.471382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:13.472008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:13.472266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-37f2252c-43c0-4923-8540-df79a4947720 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.320355 Aug 04 20:55:13.472682 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:13.473102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 46/94] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:13 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:13.659931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:13.669184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f26dea00-0867-41be-8dd6-db778783eafb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.227085 Aug 04 20:55:13.670173 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 49/95] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:13 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:14.160455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:14.165317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:14.165903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:14.167614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:14.174696 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.175093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.175838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.176408 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.176942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.177080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.177690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.178691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.179393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.180512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.181333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.183268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.485068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.500779 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.510905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-246fc572-7be8-4a3e-a548-7cb7fc66619b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.355123 Aug 04 20:55:14.513528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b1647bcf-898f-494b-9ede-a568fdb2f74d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.351501 Aug 04 20:55:14.514113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 50/96] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:14 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:14.528730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 47/97] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:14 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:14.544821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:14.545450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:14.546468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:14.547082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:14.557144 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.557875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.558468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.559379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.560016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.560623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.561936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.562438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.563010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.565091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.565682 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.566230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.835462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.844999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4618f7d8-d284-4b68-b672-9496eb7de7fd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.313416 Aug 04 20:55:14.845604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 48/98] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:14 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:14.861468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.870849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:14.874035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.874829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:14.876492 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:14.879773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7f6278f5-336a-4534-8337-68013143c31d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.341347 Aug 04 20:55:14.897392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 51/99] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:14 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:14.901166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.901760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.902932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:14.903644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:14.904096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:14.904705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:15.125629 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:15.142353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b44d3d21-bbf0-4926-9277-efc2603e6fb7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.295698 Aug 04 20:55:15.144861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 49/100] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:14 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:15.543303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:15.543997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:15.545494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:15.546732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:15.560397 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:15.560892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:15.561171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:15.561320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:15.562356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:15.562976 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:15.563379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:15.563557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:15.564172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:15.565814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:15.566781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:15.567902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.414976 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.426244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e042331a-d763-4717-9a8f-d305ed9635d3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.887118 Aug 04 20:55:16.430555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:15 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:16.433844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.445043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:16.445664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6cca075f-9f27-41ba-bb63-e6c05a409be7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.907897 Aug 04 20:55:16.447328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:16.458163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 52/102] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:15 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:16.465141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.465880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:16.466086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.466634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.466987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:16.467531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.468297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.468864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.473477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.473951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.474591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.475769 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.476405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.476969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.816653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.825254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.827936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.830399 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:16.831784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc554c04-cea7-4d96-8a36-057c1f5793e5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.372481 Aug 04 20:55:16.845836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 53/103] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:16 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:16.852719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-462bd302-d9a2-4858-86d8-6c5e65110c2f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.417081 Aug 04 20:55:16.854279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 51/104] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:16 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:16.854982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:16.855821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:16.860108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:16.861817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.862314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.862757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.863458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.863914 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.864368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.871093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:16.871566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:16.871994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:16.889711 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] Creating event network-changed:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:55:16.900945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-166d4de3-aa0c-42d2-b759-398c6dae225a req-0ef6fd16-1229-43c9-86a8-be68c199c0aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Aug 04 20:55:16.901574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 52/105] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:17.096821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:17.107157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-58282407-e414-460d-b1d0-d0051ac89199 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.260002 Aug 04 20:55:17.108016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 54/106] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:16 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:17.208282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1d56ce-6efb-434e-a0cd-ff779d42d4b1", "tag": "6740c24c-2bad-4b5c-9c91-33db23f3d429"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:17.223611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.224239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.225059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.242050 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] Creating event network-changed:6740c24c-2bad-4b5c-9c91-33db23f3d429 for instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 on hv-cinder-83602 Aug 04 20:55:17.249924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-a0a43e1d-d88e-4654-8fdc-5f0a22e2d2cf req-3689b89b-0463-4b24-a5ff-7c49d7f81901 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046922 Aug 04 20:55:17.250950 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 53/107] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:17.456581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:17.457199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:17.464160 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.465218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.465656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.466352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.466802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.467219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.470519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:17.471374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:17.479817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.480300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.480761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.481449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.481900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.482317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.615460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:17.686935 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:17.691627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:17.696901 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-28b3282b-6bd2-4594-8690-f30b41b47000 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.248263 Aug 04 20:55:17.702346 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 55/108] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:17 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:17.707398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-70c47132-8857-4bcc-9001-46bce65cdd9a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.241130 Aug 04 20:55:17.708221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 54/109] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:17 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:17.861624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:17.862998 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:17.873305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.874316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.875051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:17.875723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:17.876185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.877129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.877797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.879374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.888954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.892136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.892623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:17.894085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:17.894461 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:17.894897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.078106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:18.086878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:18.089528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:18.091152 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a968e61-fdaf-420f-8e46-a08073756eb7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.235060 Aug 04 20:55:18.104588 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 56/110] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:17 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:18.105575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:18.115067 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e8de7785-7e3f-4c1e-bc7a-702cc46fcf93 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.244168 Aug 04 20:55:18.116290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 55/111] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:17 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:18.129530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:18.130369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:18.138910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.139541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.140067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.140884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.141389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.141873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.288231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:18.295362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86aa6f8d-1547-4bb1-ae72-f6d99cf09a29 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.170086 Aug 04 20:55:18.296021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 57/112] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:18 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:18.396039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4eef31-8b60-4328-adde-046f701b8d15", "name": "network-vif-plugged", "status": "completed", "tag": "91c963eb-7115-4422-87fd-8a3f75efd3d6"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:18.410093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.410919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.411667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.425084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] Creating event network-vif-plugged:91c963eb-7115-4422-87fd-8a3f75efd3d6 for instance cd4eef31-8b60-4328-adde-046f701b8d15 on hv-cinder-83602 Aug 04 20:55:18.434883 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-eff96358-7bf9-4b20-bd8b-f211657ae224 req-cddb48b6-9a14-4bf1-9549-ae374abdc8d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095758 Aug 04 20:55:18.435694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 56/113] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:18.726748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:18.727886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:18.743099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:18.745069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:18.752665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.753139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.754008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.754280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.754736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.755167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.773311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.775941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.777432 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:18.778425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:18.779110 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:18.779748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.552718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.555925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.565316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b1979c7a-aa70-4a2c-8849-ae24ffdc0ff3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.848944 Aug 04 20:55:19.566524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 58/114] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:18 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:19.576139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0845fd7e-18a3-446e-85de-cb65a83e34e1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.836191 Aug 04 20:55:19.576139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 57/115] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:18 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:19.583808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:19.584744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:19.596998 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.597497 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.597641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:19.597935 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.598323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:19.598638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.599093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.599519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.600363 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:19.606975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.607466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.607906 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.608661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.609119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.609548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.804553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.829619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c5462d05-af50-43b6-b77d-2ebff39cac8c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.251729 Aug 04 20:55:19.830457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 59/116] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:19 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:19.847045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:19.858921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:19.868197 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.868735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.869166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.870322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:19.870887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:19.871358 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:19.946584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.958746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.960475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:19.961358 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0eb8eb7d-9f4c-4af6-b66e-cab09b7d37b8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.391644 Aug 04 20:55:19.961907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 58/117] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:19 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:20.114169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:20.123803 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc43149f-5131-468e-ac02-877c22c99d96 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.292122 Aug 04 20:55:20.124899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 60/118] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:19 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:20.591589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:20.592819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:20.598284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:20.598895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:20.599432 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.599714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.600148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.600870 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.601339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.601740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.610215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.610777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.611221 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.611932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.612418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.612851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.821170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:20.823247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:20.830524 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-adfb6bfc-3fdc-4f5f-8293-27f9c014a5c2 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.245857 Aug 04 20:55:20.844370 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fda4bdff-f7fc-4406-ac34-1b88366d4dc2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.238237 Aug 04 20:55:20.844370 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 61/119] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:20 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:20.846155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 59/120] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:20 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:20.854702 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:20.856383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:20.863107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.863595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.864308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.865153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:20.865536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:20.866100 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:20.997407 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:20.998630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:21.021226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.021723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.022163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.022869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.023325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.023751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.127947 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:21.138612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-287b7abe-8d0c-4604-9978-4d27743651d3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.289151 Aug 04 20:55:21.139200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 62/121] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:20 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:21.159530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:21.160517 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:21.168212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.169187 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.170024 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.175901 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.176781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.177531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.263083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:21.273974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:21.275706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:21.277019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-25677be0-6741-4ba9-9703-fc8162fb4bcd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.295115 Aug 04 20:55:21.280376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 60/122] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:20 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:21.394649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:21.403041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c4dd18cc-3384-4471-9e25-16ab600ccb76 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.249141 Aug 04 20:55:21.403634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 63/123] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:21 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:21.870467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:21.872778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:21.873926 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:21.874540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:21.894635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.896785 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.897708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.898611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.899428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.900923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.902267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.902939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.903654 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.906457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:21.907281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:21.908031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:21.925142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:22.166560 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.203660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-13e0d43f-bf03-44ef-84e7-7fa3bd349b3e tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.350206 Aug 04 20:55:22.205381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 61/124] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:21 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:22.210848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:22.211819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:22.218348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.219298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.220131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.221985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.223555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.224179 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.225043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.234945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8f5d9dd4-5c71-4b2e-9b7a-f1de19fa88b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.374061 Aug 04 20:55:22.236605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 64/125] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:21 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:22.263602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e886a88-4224-4e56-a476-be4fd7bf6add", "name": "network-vif-plugged", "status": "completed", "tag": "cb40fc25-352d-4823-8a9a-b69b0baaaaf6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:22.288758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.288863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.289248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.319196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] Creating event network-vif-plugged:cb40fc25-352d-4823-8a9a-b69b0baaaaf6 for instance 1e886a88-4224-4e56-a476-be4fd7bf6add on hv-cinder-83602 Aug 04 20:55:22.336029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-bb8d9ebb-c0f9-4662-a0e8-536312b54492 req-4cb92e0a-5393-4501-b29d-a0678a56e017 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074458 Aug 04 20:55:22.337626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 65/126] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:22.359836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:22.360782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:22.369533 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.370274 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.370914 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.379410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.382077 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.384003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.485465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.530795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-83fc3a5a-2f0d-4211-bfb9-64046682ebcf tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.324037 Aug 04 20:55:22.531271 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 62/127] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:22 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:22.536219 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:22.539228 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:22.556529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.558872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.560077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.561934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:22.563386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.563997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:22.565756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:22.576222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.583093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.590865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1215edbf-1b8e-4cb9-bcf7-c0d5e7e18a8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.249160 Aug 04 20:55:22.591599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 66/128] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:22 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:22.742873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:22.751818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-92eda3e7-ef69-4ae7-a651-2ceb801ce7c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.219326 Aug 04 20:55:22.752408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 63/129] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:22 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:23.225710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:23.227415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:23.235402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.236362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.237211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.238282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.239268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.240174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.258630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:23.259624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:23.269263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.269744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.270178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.270861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.271306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.271721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.296952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:23.462145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.474359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f87451e9-86d8-4469-9c14-9204d8c22beb tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.252773 Aug 04 20:55:23.488694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 67/130] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:23 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:23.503131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.538393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b85e63a3-83bb-4fa3-a938-06b156784d38 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.284611 Aug 04 20:55:23.539174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 64/131] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:23 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:23.551764 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:23.552642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:23.559264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.560056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.560605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.561301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.561755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.562180 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.613971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:23.614598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:23.621236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.621715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.622143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.622828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.623278 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.623692 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.819459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.831207 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1d04e7dc-486e-49d9-a95d-d2a8ce03f0bb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.283690 Aug 04 20:55:23.844667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 68/132] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:23 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:23.844667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:23.844667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:23.844667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.844667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.845022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.845590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:23.846049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:23.846479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:23.847495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.861050 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.863101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:23.864833 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e5f2788f-5c7d-44f1-b552-e1c453cee9a2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.254428 Aug 04 20:55:23.865655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 65/133] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:23 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:23.997435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:24.005103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e9cfec3e-7a36-4e51-8791-4c13e8495cf4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.172100 Aug 04 20:55:24.005786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:23 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:24.497058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:24.497903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:24.503519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.504005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.504471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.505152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.505605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.506029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.560960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:24.561576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:24.568455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.569041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.569531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.570247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.570709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.571132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.690787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:24.701017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-50c2058e-897d-4810-a033-da4c8fe9a8fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.207607 Aug 04 20:55:24.702244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 66/135] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:24 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:24.753801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:24.764313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-34bb3681-9382-43ef-9219-ef98cab4db15 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.207052 Aug 04 20:55:24.777238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:24 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:24.852749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:24.854630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:24.863103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.863599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.864038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.864769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.865227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.865656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.894853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:24.896275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:24.908507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.909751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.910944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:24.913557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:24.915018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:24.915985 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.124784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.136370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0bb549bf-cac4-4b04-be36-fa0f52cad8d5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.287973 Aug 04 20:55:25.136756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.137491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 67/137] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:24 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:25.152146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.155064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.156329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:25.157247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07a51fd4-faae-4526-b21d-e81198f0fd3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.270006 Aug 04 20:55:25.157907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:25.158603 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 71/138] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:24 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:25.165261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.166423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.166653 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.167198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.167641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.168205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.308933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.318621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c81f5e76-786b-4767-ae0f-ee0a188c0f72 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1360 microversion: 2.1 time: 0.179328 Aug 04 20:55:25.319250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 68/139] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:25 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:25.728120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:25.728708 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:25.735312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.735800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.736235 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.736953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.737406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.737829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.788161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:25.788791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:25.795292 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.795774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.796209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.796951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:25.797589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:25.798020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:25.916501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.932377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a12066d3-0368-4811-905a-21eebfb3037c tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.208007 Aug 04 20:55:25.933029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 72/140] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:25 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:25.965515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:25.973036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4afa909d-1511-4ec3-8008-f97f62b06294 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.188778 Aug 04 20:55:25.973596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 69/141] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:25 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:26.159812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:26.160907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:26.169989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.170880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.171621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.173328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.174290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.174860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.185190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:26.185802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:26.203705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.205093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.205724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.206581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.207167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.207717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.632971 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:26.635089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:26.643463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0afec7fc-3065-472a-a4ea-8a14383baa73 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.488558 Aug 04 20:55:26.644945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:26 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:26.645614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:26.647282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:26.648436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0e348f03-2aca-4949-b8e2-c0630369879c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.470685 Aug 04 20:55:26.650693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:26.661003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 70/143] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:26 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:26.670287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e24f4b7-a043-4e4c-b890-8afc32c415f2", "name": "network-vif-plugged", "status": "completed", "tag": "f74916b5-02e1-46c5-8888-6a70ea5a98aa"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:26.672535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:26.682651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.682924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.683265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.683440 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.683927 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.684699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.685592 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.686270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.686844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.698173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] Creating event network-vif-plugged:f74916b5-02e1-46c5-8888-6a70ea5a98aa for instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 on hv-cinder-83602 Aug 04 20:55:26.703662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-d7b4393e-fa00-4338-a412-21b9a7a72c34 req-8cf39758-69e2-440d-bc0c-096516f5a841 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041365 Aug 04 20:55:26.704261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 71/144] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:26.836566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:26.845391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fb0b50db-f4d5-4905-97a6-c05ac16e66f9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1546 microversion: 2.1 time: 0.199296 Aug 04 20:55:26.846131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 74/145] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:26 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:26.870749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:26.871308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:26.877561 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.878796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.878796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.879489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.879986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.880603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.953282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:26.954123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:26.960980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.961550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.962079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:26.962921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:26.963406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:26.963893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.009790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d7169483-9b53-4923-a4e8-8264213d8d66 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143774 Aug 04 20:55:27.011131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 72/146] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 20:55:26 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:27.016696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:27.017306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:27.023496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.023978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.024455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.025424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.025829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.026414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.177288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:27.186192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-358d1598-eafa-41e4-b50d-93bcca94b2fc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.236507 Aug 04 20:55:27.200472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:26 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:27.238348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:27.248200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-62508f68-704b-49df-8b4f-ce2b6c1f05ec tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.235797 Aug 04 20:55:27.248980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:27 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:27.675243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:27.676977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:27.677779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:27.680834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:27.705236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.707291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.708066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.708747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.709538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.710133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.711040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.712192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:27.713424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.714060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:27.714665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.715264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:27.980939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:27.994343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ecf3624b-045b-4fc7-9202-9c0fdc81b6e6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.329551 Aug 04 20:55:28.007990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:27 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:28.037055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:28.054314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:28.055804 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:28.057609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-21336bed-0c14-4cea-a1ab-2a15bf5e0591 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.387214 Aug 04 20:55:28.058169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 74/150] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:27 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:28.210524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:28.211220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:28.218842 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.219593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.220360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.221266 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.222011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.222612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.270955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:28.271559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:28.277975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.278715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.279533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.280458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.281174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.282084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.783928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:28.793088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0e125631-3230-4b24-b65f-51866664323d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.586437 Aug 04 20:55:28.793675 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 77/151] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:28 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:28.809550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4eef31-8b60-4328-adde-046f701b8d15", "tag": "91c963eb-7115-4422-87fd-8a3f75efd3d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:28.821351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.822277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.822710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.850366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:28.858798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e3b61424-49c3-4a54-9b58-2b1db17b74d3 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.591677 Aug 04 20:55:28.868530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:28 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:28.874827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] Creating event network-changed:91c963eb-7115-4422-87fd-8a3f75efd3d6 for instance cd4eef31-8b60-4328-adde-046f701b8d15 on hv-cinder-83602 Aug 04 20:55:28.881658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-bf78c4f2-e4cb-4e38-8c1c-44d89016db59 req-edb75798-715f-4f88-b408-3700a3761149 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075917 Aug 04 20:55:28.882822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8cf39d-924e-44b9-a724-e9cb2d7a87be", "name": "network-vif-plugged", "status": "completed", "tag": "5eb68dbc-50ad-4339-b1ca-307285f5949b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:28.882987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 78/153] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:28.896774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:28.897547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:28.898185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:28.913104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] Creating event network-vif-plugged:5eb68dbc-50ad-4339-b1ca-307285f5949b for instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be on hv-cinder-83602 Aug 04 20:55:28.919521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-ad7c101d-f84e-428a-a885-7377577d1218 req-69770c4e-1716-490a-8352-f424c3545220 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047663 Aug 04 20:55:28.920670 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 76/154] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:29.017352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:29.018723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:29.030282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.031607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.032552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.034048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.034393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.035135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.083664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:29.084499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:29.103240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.104844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.105510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.108452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.110420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.111143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.599001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:29.607960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:29.612537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:29.616853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-581a8bff-003d-4d29-97c8-f4301e66578d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.538495 Aug 04 20:55:29.617572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 77/155] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:29 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:29.661905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:29.672618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-88c0af5e-7ffb-4e88-94e3-9df3b04da229 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.660382 Aug 04 20:55:29.688440 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 79/156] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:29 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:29.816225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:29.816891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:29.825722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.827161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.828563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.830001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.832210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.833361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.884693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:29.887927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:29.901414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.903661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.904718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:29.908034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:29.908756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:29.909977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:30.190572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:30.199721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:30.204698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-deff16b3-ac98-426d-a80d-96d8d2ca4719 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.329461 Aug 04 20:55:30.207508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-dfc440ef-2238-4085-86b4-397276dcb81a tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.395241 Aug 04 20:55:30.218156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 80/157] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:29 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:30.220689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:29 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:30.643303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:30.644188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:30.653603 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:30.657694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:30.658220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:30.658977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:30.659817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:30.660420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:30.698068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:30.699960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:30.713889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:30.714749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:30.716465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:30.718486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:30.720512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:30.721152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:30.910678 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:30.925625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:30.930673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:30.932123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-30171343-82a6-401a-984e-a44171f1b07f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.292682 Aug 04 20:55:30.935326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 81/159] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:30 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:31.025764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:31.037999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-06c9b565-e17a-4b84-9605-ab2e15fbd9c9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.347224 Aug 04 20:55:31.048881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:30 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:31.232762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:31.233404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:31.233782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:31.234095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:31.239830 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:31.247747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.248245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.248716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:31.249409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.249734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.249865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.250252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.250357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:31.250652 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:31.255830 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.256463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.256945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:31.270747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:31.551262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:31.553217 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:31.561735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b0bf6869-619d-4104-8f21-ca3f6a0a1aa9 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.335333 Aug 04 20:55:31.562166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5dd7ca40-499a-4f48-84f5-8e5620d89f48 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1314 microversion: 2.1 time: 0.333989 Aug 04 20:55:31.562574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 82/161] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:31 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:31.568434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:31 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:31.956888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:31.957660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:31.964688 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.965177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.965611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:31.966305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:31.966747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:31.967168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.071243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:32.072815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:32.079355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.080068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.080603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.081746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.082390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.082895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.201145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.213856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.215927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.217593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65cbb860-7c0b-47a6-9684-2317cc7ce98e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.264307 Aug 04 20:55:32.218378 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 83/163] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:31 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:32.294947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.304402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2e4cce85-85c6-4014-ace4-2811108b0588 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.236991 Aug 04 20:55:32.305274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 81/164] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:32 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:32.584669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:32.585313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:32.591738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.591962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:32.592418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:32.592785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.593573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.594438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.595085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.595799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.598943 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.599536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.600201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.601154 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:32.601815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:32.602402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:32.815393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.827052 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1c334b3a-b2bf-46d5-8492-1f16dbc5d4b2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.246057 Aug 04 20:55:32.831409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:32.836031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:32.836437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 84/165] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:32 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:32.848157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-69515364-1077-46da-9cc5-ee01a41a06b7 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1500 microversion: 2.1 time: 0.259996 Aug 04 20:55:32.849430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 82/166] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:32 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1500 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:33.240764 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:33.241282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:33.267012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.267544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.267971 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.268849 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.269607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.270463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.329058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:33.330453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:33.358650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.360283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.360769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.363048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.363534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.363975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.570214 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:33.586794 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:33.589353 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:33.591337 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-be11b91f-2575-44a7-ae21-04ad9d0f7ff0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.354054 Aug 04 20:55:33.591925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 85/167] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:33 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:33.612117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "name": "network-vif-plugged", "status": "completed", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:33.616401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:33.631343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6d1c9bb2-203a-4459-b9fc-a99450284a43 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.309667 Aug 04 20:55:33.632027 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 83/168] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:33 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:33.638671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.639447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.640754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.652915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] Creating event network-vif-plugged:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:55:33.660023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d50d921f-c5fe-41e4-be2b-a1eb493f7077 req-1967e684-26d6-4f0a-ab29-5263669f9f69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065154 Aug 04 20:55:33.660922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 86/169] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:33.856786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:33.857398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:33.863384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.863878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.864315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:33.865043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:33.865496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:33.866812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.077008 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:34.085477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-81c8e4fa-5548-4ba7-9bab-73c7c0d5ed49 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.233209 Aug 04 20:55:34.086200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 84/170] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:33 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:34.418209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "031726c2-7ff2-451d-89d7-e4fd73258258"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:34.421358 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:34.429071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.430280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.432035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.433153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.434168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.435875 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.614055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:34.614637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:34.621175 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.621656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.622089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.622776 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.623227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.623645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.773949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:34.784128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:34.785761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:34.786881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8b46da9a-3c4e-4b09-9b82-4ded4c421f76 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.176654 Aug 04 20:55:34.787443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 85/171] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:34 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:34.792530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:34.793374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:34.805004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.805491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.806107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:34.807721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:34.808453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:34.809044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:35.015852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:35.023693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-591e1cd7-a977-46b9-8bc4-603353307e30 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.235258 Aug 04 20:55:35.024401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 86/172] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:34 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:35.110463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:35.111094 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:35.117509 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:35.117986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:35.119455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:35.120446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:35.120897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:35.121321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:35.282188 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:35.291675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2e072fc8-db6b-47fb-afba-4d2baecae433 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.185073 Aug 04 20:55:35.292352 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 87/173] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:35 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:35.810513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:35.811366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:35.818670 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:35.819021 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:35.819627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:35.820565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:35.821052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:35.821834 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:35.973514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:35.984115 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:35.985925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:35.987190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c002dd19-0802-42d1-8b9b-8ff3f1d92ba1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.181839 Aug 04 20:55:35.987825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 88/174] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:35 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:36.050784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:36.052038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:36.065548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:36.066919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:36.068224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:36.069695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:36.070986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:36.072879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:36.247661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:36.255323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-50cd310f-0e4c-4e57-ad96-e0d09bce2add tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.211175 Aug 04 20:55:36.255794 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 89/175] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:36 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:36.312825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:36.313632 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:36.324570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:36.325610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:36.328395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:36.329330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:36.329884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:36.330345 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:36.595172 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:36.603753 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-434f6548-1388-4306-bd29-141bd4d4c1e5 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1321 microversion: 2.1 time: 0.294666 Aug 04 20:55:36.604640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 90/176] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:36 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:37.012033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:37.012736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:37.019004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.019574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.020081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.020879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.021443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.021866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.174132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:37.186144 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:37.187626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:37.188751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c1e2febf-9cc9-48de-a9c8-7154861a7c9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.181604 Aug 04 20:55:37.189303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 91/177] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:37 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:37.277408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:37.278029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:37.284081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.284685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.285294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.285997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.286524 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.286867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.428977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:37.437311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-faaff3e5-240b-4740-bc22-c995f2b06fb9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.163826 Aug 04 20:55:37.438226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 92/178] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:37 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:37.626210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:37.626938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:37.634662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.635891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.636608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.637423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.637979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.638642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.867327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:37.875218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-eaf28ddc-9c79-479e-8f93-5758d090f47c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1516 microversion: 2.1 time: 0.253304 Aug 04 20:55:37.888364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 93/179] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:37 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:37.898189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:37.901235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:37.907467 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.907967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.908429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.909165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:37.909619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:37.910053 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:37.938615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lazy-loading 'flavor' on Instance uuid ca8cf39d-924e-44b9-a724-e9cb2d7a87be {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:55:38.069772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cbcae62c-616b-4605-b979-dbd13bce042e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be/action" status: 200 len: 32 microversion: 2.1 time: 0.177196 Aug 04 20:55:38.070471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 94/180] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:55:37 2022] POST /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 20:55:38.081360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:38.082059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:38.089386 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.089878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.090404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.091056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.091513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.091941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.245484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:38.253487 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-91310cba-0018-4f4e-8ee2-6c50bb55adba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.176425 Aug 04 20:55:38.254058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 95/181] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:38 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:38.271357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:38.271966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:38.278965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.279449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.279889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.280609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.281064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.281486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.421429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:38.431350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:38.434275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:38.436216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-236dabbc-38d5-47bd-b12b-0791752e99fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.180800 Aug 04 20:55:38.437087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 96/182] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:38 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:38.460962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:38.461576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:38.468476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.469271 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.469706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.470417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:38.470867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:38.471296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:38.490849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:38.629442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:38.642698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1047e9d1-3f15-4e34-8aa5-ded350eff920 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.188159 Aug 04 20:55:38.643197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 97/183] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:38 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:39.275435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:39.276062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:39.281999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.282504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.282935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.283729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.284173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.284632 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.425832 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:39.434865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-838e2ece-37a6-4f26-ad3c-cf28c85c05b4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.163638 Aug 04 20:55:39.435493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 98/184] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:39 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:39.467304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:39.467932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:39.474373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.474998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.475434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.476124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.476638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.477058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.622185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:39.630633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:39.632249 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:39.633545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6735b925-fcfb-44d4-b546-128cf3b9e260 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.170468 Aug 04 20:55:39.634255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 99/185] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:39 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:39.671509 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:39.672149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:39.679703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.680559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.681589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.682286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:39.682737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:39.683153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:39.820541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:39.828816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-595bfa28-c676-432c-a0e5-ec91330ec087 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.161213 Aug 04 20:55:39.829379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 100/186] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:39 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:40.456799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:40.457407 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:40.465735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.466318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.466857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:40.467679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.468390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.469023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:40.608201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:40.615820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8de800ef-0cd6-4ce0-9869-8e839bd3f212 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.162812 Aug 04 20:55:40.616574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 101/187] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:40 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:40.667301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:40.667927 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:40.673878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.674355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.674790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:40.675729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.676581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.676757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:40.812140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:40.820903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:40.823109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:40.824263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c8954121-c0cc-477a-b7f6-cd4955ab9ca4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.160880 Aug 04 20:55:40.824859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 102/188] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:40 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:40.849938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:40.850558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:40.857121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.857606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.858051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:40.858743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:40.859220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:40.859639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:41.177294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:41.185352 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-76390455-bf2d-4dd3-b581-efca6622d2dd tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.339362 Aug 04 20:55:41.185913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 103/189] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:40 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:41.637157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:41.637795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:41.643736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:41.644210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:41.644679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:41.645356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:41.645800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:41.646215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:41.791111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:41.798721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ca7287de-7f53-4196-aec7-db7c5581fb5d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.165433 Aug 04 20:55:41.799330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 104/190] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:41 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:41.851304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:41.852511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:41.863058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:41.863605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:41.864085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:41.865038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:41.865544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:41.866295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:42.019546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:42.028917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:42.030421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:42.031592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-04487ef6-7625-4db0-a7b8-ec530188e705 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.187839 Aug 04 20:55:42.032372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 105/191] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:41 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:42.206498 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:42.207183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:42.214051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:42.214521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:42.214964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:42.215832 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:42.216298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:42.216774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:42.359112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:42.367841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a617ef8c-9a99-431f-9c73-aa6802515359 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.165212 Aug 04 20:55:42.369119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 106/192] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:42 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:42.824819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:42.825557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:42.831851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:42.832356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:42.832881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:42.833650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:42.834103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:42.834529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:42.911748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5f386bd8-dcb5-4f08-ae35-824f168e1330 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "POST /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.500622 Aug 04 20:55:42.913019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 87/193] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:55:34 2022] POST /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add/os-volume_attachments => generated 194 bytes in 8503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:43.057239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:43.057915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:43.064734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:43.065222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:43.065760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:43.066427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:43.067014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:43.067445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:43.112705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:43.124136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-34ac3b98-091a-4ffd-aaa2-4f04a061e407 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.305308 Aug 04 20:55:43.124775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 107/194] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:42 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:43.218406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:43.226301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:43.228328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:43.230128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d82e8002-a8c0-432f-bf97-ec5894a86ef9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.178739 Aug 04 20:55:43.230605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 88/195] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:43 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:43.393290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:43.399708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:43.402082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:43.407474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:43.407991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:43.408456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:43.409354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:43.409700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:43.410124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:43.558873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:43.567244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-026d528b-12ca-42f3-89f3-d2f3d68636c2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.177723 Aug 04 20:55:43.567817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 108/196] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:43 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:44.146553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:44.147228 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:44.157729 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.158293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.158771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.159363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.159871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.161062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.254617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:44.255819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:44.263919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.265133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.265618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.266537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.267137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.267771 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.365636 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:44.374069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75876465-5ee0-47f0-a45d-50702151384b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.231910 Aug 04 20:55:44.374645 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 89/197] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:44 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:44.411854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1d56ce-6efb-434e-a0cd-ff779d42d4b1", "name": "network-vif-plugged", "status": "completed", "tag": "6740c24c-2bad-4b5c-9c91-33db23f3d429"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:44.424583 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.425225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.425918 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.437427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:44.438323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] Creating event network-vif-plugged:6740c24c-2bad-4b5c-9c91-33db23f3d429 for instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 on hv-cinder-83602 Aug 04 20:55:44.443335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ba6d0c75-c26b-4dfa-b2aa-954eb647b0a9 req-0cd4c0a0-48f8-49cd-b4d0-82a469fabe88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035551 Aug 04 20:55:44.443931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 90/198] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:55:44.446859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:44.448614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:44.449737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-39cde5e2-7163-449c-9743-1fcd1570baf0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1408 microversion: 2.20 time: 0.199584 Aug 04 20:55:44.450323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 109/199] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:44 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:55:44.590890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:44.591621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:44.598641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.599131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.599563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.600241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:44.600716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:44.601150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:44.840933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:44.852254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5111cdeb-4b3e-47c0-8e27-9f220aa18040 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.266395 Aug 04 20:55:44.867078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 91/200] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:44 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:45.394575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:45.395173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:45.401770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.402257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.402688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.403370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.403817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.404235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.473183 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:45.473825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:45.481708 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.482204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.482673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.483383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.483970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.484424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.594627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:45.603397 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bf41c3e6-ce7d-49e5-b48a-b97ed36e91e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.212537 Aug 04 20:55:45.604162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 110/201] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:45 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:45.662865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:45.674283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:45.676147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:45.677427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1982e590-7592-4979-bf24-cbc3c35de4a5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1600 microversion: 2.20 time: 0.208516 Aug 04 20:55:45.677992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 92/202] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:55:45 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:55:45.708161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:45.709480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:45.720835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.721460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.722131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.723436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.724274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.725209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.802770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ba98a844-b0f9-4da8-a235-f77793c86a21 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100837 Aug 04 20:55:45.803365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 111/203] 10.222.0.52 () {60 vars in 1316 bytes} [Thu Aug 4 20:55:45 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:55:45.875248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:45.876131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:45.882609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.883328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.884311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:45.885053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:45.885632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:45.886062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:46.496868 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:46.510896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5f0c5b2b-7717-4613-bd2e-9b6339b709f2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.640074 Aug 04 20:55:46.511785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 93/204] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:45 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:46.631353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:46.632369 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:46.640017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:46.641031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:46.641689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:46.642637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:46.643341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:46.644041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:47.186918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:47.197337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8f67179d-0ef1-43d3-95be-941483bb902b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.570325 Aug 04 20:55:47.198639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 112/205] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:46 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:47.536042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:47.537131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:47.547739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:47.548367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:47.548874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:47.549764 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:47.551177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:47.552059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:48.026923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:48.035030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eeab7796-0d4c-4907-aace-080db8e22453 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1364 microversion: 2.1 time: 0.504858 Aug 04 20:55:48.046547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 94/206] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:47 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:48.198991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:48.216494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:48.217531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:48.218373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:48.221459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:48.222324 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:48.232317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:48.232874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:48.234039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:48.237424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:48.237936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:48.238373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:48.240533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] Creating event network-changed:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:55:48.247797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-f2a242a6-0db5-435d-9f97-c1f3e01f1e95 req-0b8a2369-7633-454e-ac76-0899405df935 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054019 Aug 04 20:55:48.249128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 113/207] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:48.514240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:48.526873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7488c3f6-15d8-4053-ae22-0314e3964f0f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.310481 Aug 04 20:55:48.538987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 95/208] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:48 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:49.063385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:49.064012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:49.070722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.071258 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.071696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.072642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.073684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.073684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.226126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:49.234390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7248fe90-9142-4fea-a134-530f6e2da80c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1554 microversion: 2.1 time: 0.180963 Aug 04 20:55:49.235094 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 114/209] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:49 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:49.256751 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:49.256863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:49.264050 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.264669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.265086 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.265796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.266258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.266916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.353829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d73bd696-2d3d-4828-be73-c884fda2e838 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099911 Aug 04 20:55:49.354437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 96/210] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 20:55:49 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:49.551672 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:49.552273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:49.564955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.565835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.566273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.566973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:49.567442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:49.568378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:49.609922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:49.904449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:49.909868 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-17a889ab-43a5-43e9-9db7-43ac93c02cf8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.362311 Aug 04 20:55:49.912617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 115/211] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:49 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:50.753108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1d56ce-6efb-434e-a0cd-ff779d42d4b1", "tag": "6740c24c-2bad-4b5c-9c91-33db23f3d429"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:55:50.769112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:50.769838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:50.770461 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:50.784925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] Creating event network-changed:6740c24c-2bad-4b5c-9c91-33db23f3d429 for instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 on hv-cinder-83602 Aug 04 20:55:50.791485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e4550b0e-e64a-431f-8e15-06876b085317 req-0eaaafa5-e05e-4b04-a4db-e08d7886babb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042408 Aug 04 20:55:50.792326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 97/212] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:55:50.936071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:50.936799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:50.945621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:50.946546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:50.947196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:50.948185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:50.948702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:50.949139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:51.215663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:51.230268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8b555413-87fc-4ccf-b75b-566640041a4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.298473 Aug 04 20:55:51.236694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 116/213] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:50 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:52.262282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:52.263234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:52.271336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:52.271823 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:52.272265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:52.273077 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:52.273542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:52.273956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:52.434094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:52.443108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f6c227b-3043-4baa-ae5b-0c9724437b3e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.186874 Aug 04 20:55:52.443752 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 98/214] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:52 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:53.464610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:53.465227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:53.472395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:53.473058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:53.473493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:53.474341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:53.474802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:53.475228 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:53.618671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:53.627186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d446cb22-0859-4f8b-8e32-b2f6da76fb60 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.166727 Aug 04 20:55:53.627751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 117/215] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:53 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:54.651344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:54.651968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:54.658963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:54.659499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:54.659938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:54.660685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:54.661175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:54.661710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:54.807702 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:54.811808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:54.817328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07e63c47-d74a-48c4-9f45-7c59fac1f27b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.170678 Aug 04 20:55:54.817937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 99/216] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:54 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:55.841643 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:55.842329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:55.848367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:55.848955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:55.849433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:55.850310 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:55.850767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:55.851348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:55.990809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:55.998485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-179f11b9-a079-44f8-8c46-b739e4ec563c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.160723 Aug 04 20:55:55.999040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 118/217] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:55 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:57.018935 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:57.019554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:57.027659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:57.028425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:57.029529 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:57.030679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:57.031756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:57.032456 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:57.185158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:57.192580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a87c552-0db8-40a9-b178-795a6e9d4712 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.177374 Aug 04 20:55:57.193145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 100/218] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:57 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:55:58.212798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:58.213399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:58.219701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:58.220181 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:58.220659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:58.221364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:58.221820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:58.222239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:58.356726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:58.364535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2c2c9e42-35c3-41f6-b7d4-6e32f63dde52 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.155561 Aug 04 20:55:58.365102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 119/219] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:58 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:55:59.387277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:55:59.387792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:55:59.394333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:59.394817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:59.395260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:59.395953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:55:59.396447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:55:59.396879 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:55:59.530738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:55:59.538496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0d23b94-582a-401d-9491-92c8f782cf92 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.155595 Aug 04 20:55:59.538958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 101/220] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:55:59 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:00.560778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:00.561385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:00.568062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:00.568636 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:00.569040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:00.569824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:00.570304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:00.570732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:00.711494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:00.720136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b132eb04-dbc3-4519-92d7-a1a8d28c0ba6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.163177 Aug 04 20:56:00.720743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 120/221] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:00 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:01.741618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:01.742202 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:01.744447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=39 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:01.749801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:01.750277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:01.750707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:01.751389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:01.751839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:01.752274 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:01.883277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:01.890868 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4910a6fe-bc5c-4689-adeb-1e9dae887083 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.153232 Aug 04 20:56:01.891434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 102/222] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:01 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:02.911849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:02.912515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:02.918720 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:02.919213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:02.919622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:02.920295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:02.920775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:02.921245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:03.063514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:03.071482 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5cd1b10f-e4e0-49dd-ae8e-c793d42c51f8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.163425 Aug 04 20:56:03.072197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 121/223] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:02 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:04.092723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:04.093327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:04.100367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:04.100852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:04.101282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:04.102147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:04.102745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:04.103314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:04.258859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:04.269594 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e6ba8e15-68fd-4898-a76e-d31c7c768c1c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.181114 Aug 04 20:56:04.270260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 103/224] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:04 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:05.290651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:05.291337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:05.298454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:05.299011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:05.299450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:05.300143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:05.300882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:05.301350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:05.438600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:05.449276 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0479991e-5c31-40f0-b9e1-d5656015e0ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.162093 Aug 04 20:56:05.449823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 122/225] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:05 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:06.478988 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:06.484979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:06.493845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:06.494345 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:06.495637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:06.496974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:06.497641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:06.498308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:06.772731 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:06.781123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0cff4959-5566-4086-8958-10abcc05adfb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.314059 Aug 04 20:56:06.781927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 104/226] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:06 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:07.801273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:07.801876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:07.808113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:07.808418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:07.808852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:07.809541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:07.809994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:07.810417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:07.962650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:07.971566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9c4b39ec-595f-4826-ae6b-5964046fd207 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.174414 Aug 04 20:56:07.972149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 123/227] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:07 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:08.992541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:08.993318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:08.999795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:09.000747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:09.000747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:09.001436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:09.001897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:09.002441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:09.139374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:09.147629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f9905441-0b49-4c52-ade0-51b44708f3ea tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.158857 Aug 04 20:56:09.148299 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 105/228] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:08 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:10.169189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:10.169809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:10.176789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:10.177299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:10.177848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:10.178659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:10.179148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:10.179580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:10.316717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:10.324206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3e307ee9-b1f6-4530-ba36-d1e580be402c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.159717 Aug 04 20:56:10.324815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 124/229] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:10 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:11.348672 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:11.349506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:11.356698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:11.357193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:11.357631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:11.358330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:11.358786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:11.359204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:11.503033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:11.511319 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eb19fe08-621f-4491-a348-5743c1334107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.167078 Aug 04 20:56:11.511907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 106/230] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:11 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:12.531806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:12.532946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:12.539069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:12.539554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:12.539993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:12.540706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:12.541169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:12.542097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:12.684759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:12.692667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a8f3fc2d-8a36-4f82-8e15-a6201e59a9ce tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.164962 Aug 04 20:56:12.693262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 125/231] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:12 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:13.022490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:13.022988 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:13.030320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.030812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.031257 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.031957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.032448 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.032882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.060887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 20:56:13.147507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-23c48335-f5f6-425a-857e-fec0f0aa6733 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 204 len: 0 microversion: 2.1 time: 0.128538 Aug 04 20:56:13.148096 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 107/232] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 20:56:13 2022] DELETE /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 20:56:13.157230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:13.157964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:13.163840 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.164324 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.164803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.165493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.165952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.166380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.304867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:13.312992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d1e84010-7985-4e07-8ca9-5f4f8ad555b5 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1552 microversion: 2.1 time: 0.160079 Aug 04 20:56:13.313580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 126/233] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:13 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:13.714775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:13.715514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:13.721815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.722395 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.722902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.723660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:13.724190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:13.724643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:13.863859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:13.871961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5fb86717-2db4-45a1-be1b-0a6260886730 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.161950 Aug 04 20:56:13.872620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 108/234] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:13 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:14.334227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:14.334830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:14.336645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=38 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:14.342383 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:14.342866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:14.343336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:14.344020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:14.344508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:14.344932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:14.483407 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:14.491573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3143aeb4-d001-4394-a612-73604e6355dc tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1552 microversion: 2.1 time: 0.161180 Aug 04 20:56:14.492133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 127/235] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:14 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:14.895074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:14.895706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:14.902724 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:14.903211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:14.903645 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:14.904361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:14.904990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:14.905416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:15.061795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:15.069378 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5710678a-13ef-41e9-9a59-8d267f4430c4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.179451 Aug 04 20:56:15.069984 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 109/236] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:14 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:15.523423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:15.523423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:15.523423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:15.523423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:15.524034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:15.524034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:15.524034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:15.524034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:15.658782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:15.666679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9a2ed997-5f9e-4247-a855-5f11d709e67d tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1552 microversion: 2.1 time: 0.157503 Aug 04 20:56:15.667264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 128/237] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:15 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:16.089821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:16.090543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:16.096904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:16.097387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:16.097816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:16.098500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:16.098965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:16.099399 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:16.246252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:16.253672 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-71ca9a36-d098-4ee1-a1e8-2d519f625ad1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.167657 Aug 04 20:56:16.254244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 110/238] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:16 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:16.688135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:16.689540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:16.703167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:16.704424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:16.705561 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:16.707200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:16.707883 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:16.708442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:16.878259 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:16.887714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-595ab9f9-e65c-4bd5-8adb-aabd9ba9fa67 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1552 microversion: 2.1 time: 0.203457 Aug 04 20:56:16.897590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 129/239] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:16 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1552 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:17.280840 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:17.282741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:17.295801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:17.296470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:17.297236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:17.298437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:17.299245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:17.299995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:17.622081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:17.630475 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e276a1e8-887e-4b27-9824-1062d55c3536 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.358334 Aug 04 20:56:17.631064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 111/240] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:17 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:17.912901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:17.914420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:17.923182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:17.924003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:17.924648 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:17.926243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:17.926874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:17.927503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:18.206375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:18.216899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5b75c9d8-e195-4b1d-a148-4c3b46bce593 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1552 microversion: 2.1 time: 0.308870 Aug 04 20:56:18.217897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 130/241] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:17 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1552 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:18.388919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e886a88-4224-4e56-a476-be4fd7bf6add", "name": "network-vif-deleted", "tag": "cb40fc25-352d-4823-8a9a-b69b0baaaaf6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:18.402885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:18.403379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:18.403821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:18.415241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] Creating event network-vif-deleted:cb40fc25-352d-4823-8a9a-b69b0baaaaf6 for instance 1e886a88-4224-4e56-a476-be4fd7bf6add on hv-cinder-83602 Aug 04 20:56:18.422128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9ce70306-83fc-4c1e-bdd1-60a39d9da9cb req-ce1cc13f-371f-47ff-b408-687037266c03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037546 Aug 04 20:56:18.424814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 112/242] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:56:18.653580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:18.654369 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:18.660998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:18.662942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:18.663334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:18.664145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:18.664714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:18.665211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:18.839704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:18.846430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:18.849384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-632823ae-0e0e-45cd-b793-7d5fbfc1e75f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.201601 Aug 04 20:56:18.850843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 131/243] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:18 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:19.240377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:19.241479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:19.253310 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:19.255993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:19.256499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:19.257244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:19.257703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:19.258130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:19.423926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:19.434299 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2b4e85f2-f2d9-45c6-9232-7336b4861a62 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1345 microversion: 2.1 time: 0.198900 Aug 04 20:56:19.435013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 113/244] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:19 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1345 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:19.872071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:19.872894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:19.880835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:19.881254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:19.881698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:19.882432 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:19.882894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:19.883322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:20.103175 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:20.113693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3c174ea1-61dc-4529-b57f-3c7e22e0b905 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1522 microversion: 2.1 time: 0.246128 Aug 04 20:56:20.114840 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 132/245] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:19 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:20.466726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:20.468155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:20.480650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:20.481541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:20.482393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:20.485325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:20.486182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:20.486854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:20.555368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:20.556857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:20.557301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:20.560269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lazy-loading 'fault' on Instance uuid 1e886a88-4224-4e56-a476-be4fd7bf6add {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:56:20.660872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfdbada2f1a74976b42d299a813335cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281963666cbf4245a97cbb213a3fa0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:20.674253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a97ada58-4771-416d-bee9-58e2c0077d37 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 200 len: 1350 microversion: 2.1 time: 0.211335 Aug 04 20:56:20.694606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 114/246] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:20 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 1350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:21.138053 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:21.139879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:21.148620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.150163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.151108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.152812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.153907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.154525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.347910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:21.358124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c0e13be8-e62e-469a-9ad3-12f3d9bf2570 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1502 microversion: 2.1 time: 0.226235 Aug 04 20:56:21.373432 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 133/247] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:21 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:21.382200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:21.382820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:21.405703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.406450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.407080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.407969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.408815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.409644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.448407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:21.673464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:21.684405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bcbbfea9-e2ce-4089-8c1a-377a0edabcf1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1516 microversion: 2.1 time: 0.306133 Aug 04 20:56:21.700769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:21.701808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:21.709742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 115/248] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:21 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:21.717890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.718474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.719597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.721039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.722417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.723907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.746486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] HTTP exception thrown: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Request method failure captured: Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add HTTP/1.1 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIRncgQ8kD5bLfSd_-uNtEnFK9tJGkTABiRkGC87wkN_Mp020Un89LquCuyWlk0ix2d9WU_hZ4tAp55pystJSwaA8TTepDf1Jexx6HJMOXrGpVoloAFjcJy-WcF6bBZ9oruAz95UadWvdB4VnQX2OCW76CU0lgjH5Am710UHUlwSdw Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 20:56:21.754683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_281963666cbf4245a97cbb213a3fa0e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/281963666cbf4245a97cbb213a3fa0e8"}]}] Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: cfdbada2f1a74976b42d299a813335cf Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:21.756210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '1e886a88-4224-4e56-a476-be4fd7bf6add'} Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:56:21.757100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:21.759205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:21.766178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Returning 404 to user: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:56:21.767112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-29616a61-7484-43e5-938b-ed7a1ee842b3 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 404 len: 111 microversion: 2.1 time: 0.071871 Aug 04 20:56:21.771096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 134/249] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:21 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 20:56:21.952571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:21.958843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:21.966691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.967703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.968153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:21.969539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:21.972208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:21.972846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:22.040056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] HTTP exception thrown: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Request method failure captured: Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add/os-volume_attachments HTTP/1.1 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIRncgQ8kD5bLfSd_-uNtEnFK9tJGkTABiRkGC87wkN_Mp020Un89LquCuyWlk0ix2d9WU_hZ4tAp55pystJSwaA8TTepDf1Jexx6HJMOXrGpVoloAFjcJy-WcF6bBZ9oruAz95UadWvdB4VnQX2OCW76CU0lgjH5Am710UHUlwSdw Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 20:56:22.051465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_281963666cbf4245a97cbb213a3fa0e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/281963666cbf4245a97cbb213a3fa0e8"}]}] Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: cfdbada2f1a74976b42d299a813335cf Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:22.053053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '1e886a88-4224-4e56-a476-be4fd7bf6add'} Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:56:22.053886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:22.055167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:22.061043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Returning 404 to user: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:56:22.084403 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f25df98-9fe9-4787-98bd-005d452c4134 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.140979 Aug 04 20:56:22.085380 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 116/250] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 20:56:21 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add/os-volume_attachments => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 20:56:23.562496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:23.563968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:23.571539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:23.575640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:23.576709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:23.578410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:23.578900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:23.579343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:23.609985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] HTTP exception thrown: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Request method failure captured: Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add HTTP/1.1 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIRncgQ8kD5bLfSd_-uNtEnFK9tJGkTABiRkGC87wkN_Mp020Un89LquCuyWlk0ix2d9WU_hZ4tAp55pystJSwaA8TTepDf1Jexx6HJMOXrGpVoloAFjcJy-WcF6bBZ9oruAz95UadWvdB4VnQX2OCW76CU0lgjH5Am710UHUlwSdw Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 20:56:23.611592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_281963666cbf4245a97cbb213a3fa0e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/281963666cbf4245a97cbb213a3fa0e8"}]}] Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: cfdbada2f1a74976b42d299a813335cf Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.613010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '1e886a88-4224-4e56-a476-be4fd7bf6add'} Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:56:23.613790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.614994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.616762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Returning 404 to user: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:56:23.617995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b585405c-93d2-4597-9837-dfee7c282b71 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 404 len: 111 microversion: 2.1 time: 0.059850 Aug 04 20:56:23.618171 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 135/251] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 20:56:23 2022] DELETE /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 20:56:23.626355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:23.626978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] [instance: 1e886a88-4224-4e56-a476-be4fd7bf6add] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:23.634288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:23.634789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:23.635238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:23.636458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:23.636933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:23.637363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:23.663091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] HTTP exception thrown: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Request method failure captured: Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add HTTP/1.1 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIRncgQ8kD5bLfSd_-uNtEnFK9tJGkTABiRkGC87wkN_Mp020Un89LquCuyWlk0ix2d9WU_hZ4tAp55pystJSwaA8TTepDf1Jexx6HJMOXrGpVoloAFjcJy-WcF6bBZ9oruAz95UadWvdB4VnQX2OCW76CU0lgjH5Am710UHUlwSdw Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 20:56:23.665442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/281963666cbf4245a97cbb213a3fa0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_281963666cbf4245a97cbb213a3fa0e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/281963666cbf4245a97cbb213a3fa0e8"}]}] Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 281963666cbf4245a97cbb213a3fa0e8 Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-DeleteServersTestJSON-506654682 Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: cfdbada2f1a74976b42d299a813335cf Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-DeleteServersTestJSON-506654682-project Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.666651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '1e886a88-4224-4e56-a476-be4fd7bf6add'} Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:56:23.668220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. Aug 04 20:56:23.669782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 20:56:23.671022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] Returning 404 to user: Instance 1e886a88-4224-4e56-a476-be4fd7bf6add could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:56:23.671022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-87093bd2-b750-4a4a-917a-9061dae13811 tempest-DeleteServersTestJSON-506654682 tempest-DeleteServersTestJSON-506654682-project] 10.222.0.52 "GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add" status: 404 len: 111 microversion: 2.1 time: 0.044800 Aug 04 20:56:23.671923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 117/252] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:23 2022] GET /compute/v2.1/servers/1e886a88-4224-4e56-a476-be4fd7bf6add => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 20:56:24.690077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:24.692892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:24.703722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:24.713207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:24.715674 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:24.717627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:24.718491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:24.719604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:24.755802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lazy-loading 'flavor' on Instance uuid 6e24f4b7-a043-4e4c-b890-8afc32c415f2 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:56:24.912510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ced13911-5df5-4207-99bb-044ecd6462ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/action" status: 200 len: 32 microversion: 2.1 time: 0.226366 Aug 04 20:56:24.919342 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 136/253] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:56:24 2022] POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 20:56:24.924709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:24.926375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:24.942537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:24.948802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:24.949537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:24.950927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:24.951902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:24.952595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:25.416295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:25.428767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9540eea7-eea4-4821-b354-9cab376efd69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.508604 Aug 04 20:56:25.431988 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 118/254] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:24 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:26.459491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:26.460266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:26.468790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:26.469373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:26.469876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:26.475613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:26.477020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:26.478744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:26.847732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:26.860055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9555bc29-3f7d-4b20-8ab3-e4ec04b13274 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.407155 Aug 04 20:56:26.860966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 137/255] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:26 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:27.886880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:27.887916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:27.897882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:27.898401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:27.898837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:27.899572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:27.900030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:27.900476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:28.228382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:28.237753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-541803c1-2526-4e7b-a10b-bb0b7fba8a47 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.355123 Aug 04 20:56:28.238328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 119/256] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:27 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:29.259602 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:29.260221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:29.271303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:29.271846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:29.273815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:29.276299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:29.277225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:29.277668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:29.552665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:29.563892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b8f339a7-386a-4ed3-87a0-35e3a4f93d2f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.308130 Aug 04 20:56:29.567430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 138/257] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:29 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:30.586735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:30.587539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:30.598543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:30.599621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:30.600469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:30.601521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:30.602256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:30.602969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:30.839322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:30.850077 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dd6fd831-721b-47b8-91bc-31ec4b4424b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.267107 Aug 04 20:56:30.861951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 120/258] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:30 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:31.911747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:31.914314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:31.947422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:31.951260 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:31.951723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:31.952483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:31.952951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:31.953382 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:32.225180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:32.239797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bb0de6b6-33d6-4815-8e99-0a667d3d2fad tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.361719 Aug 04 20:56:32.244423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 139/259] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:31 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:33.261894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:33.262860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:33.266894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:33.275321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:33.276225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:33.276940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:33.278161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:33.279065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:33.280455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:33.500109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:33.507585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0be2f3f5-07de-4e71-94a2-1ade985c6df0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.250313 Aug 04 20:56:33.508585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 121/260] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:33 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:34.530424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:34.531044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:34.542589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:34.543484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:34.543974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:34.546343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:34.546822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:34.548919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:34.780529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:34.795734 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a4370680-402e-4c47-8bcf-3a189e91b1ae tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.270013 Aug 04 20:56:34.809921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 140/261] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:34 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:35.826200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:35.829723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:35.850161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:35.851738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:35.852791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:35.855289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:35.856524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:35.857542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:36.142519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:36.153891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a25925a2-065c-49fd-a783-f0cdbb33470a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.337344 Aug 04 20:56:36.171017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 122/262] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:35 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:37.174157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:37.175051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:37.188512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:37.191095 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:37.192085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:37.193057 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:37.194094 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:37.194977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:37.424671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:37.434314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bf887413-bdfc-43f9-9727-1555cd88ea9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.263901 Aug 04 20:56:37.435608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 141/263] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:37 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:38.457185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:38.459006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:38.473436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:38.473934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:38.474554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:38.477541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:38.478035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:38.478476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:38.752745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:38.762220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c2ea5d7-0c62-4e0c-ab46-d5c524222608 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.309537 Aug 04 20:56:38.777359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 123/264] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:38 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:39.786077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:39.787526 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:39.806239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:39.808530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:39.810541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:39.813778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:39.814788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:39.815535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:40.051627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:40.074944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-821fcea6-cca0-4d22-a9e0-76a26d47aa56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.295168 Aug 04 20:56:40.076051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 142/265] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:39 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:41.095865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:41.096511 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:41.108200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.110774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.111435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.114084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.115781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.116223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.316282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:41.329566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f1e4e978-da46-4aa3-a706-42515fb5ccfd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1502 microversion: 2.1 time: 0.237347 Aug 04 20:56:41.330876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 124/266] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:41 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:41.351386 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab3d630d-7ca9-4657-866e-05dfabc8d7e0"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:41.355015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:41.361785 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.362503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.363111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.363971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.364608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.365200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.389514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 while it is in vm_state rescued Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Request method failure captured: Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/os-volume_attachments HTTP/1.1 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 74 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIQNppqY5vBQmsM6c9o9J2g_L-miWgWjHtRPAL8pPfldZGlx-4byeGzbkV0np4zmqu6mbeZmw6uHp4EAxOtKZ0M7SNMI2CLd3OCkUfEo1Rm1w2147YPcI3vtQaT2l2lvssKcblCafFWxPsgIxp4h9jDuNkHa1R-dNUyzR13XzNSCU0 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 20:56:41.392226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71b3821ed2f44e848959ac9d2683dab6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71b3821ed2f44e848959ac9d2683dab6"}]}] Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 5026c90f0e3d49669c335ef542280409 Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {"volumeAttachment": {"volumeId": "ab3d630d-7ca9-4657-866e-05dfabc8d7e0"}} Aug 04 20:56:41.393574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Cannot 'attach_volume' instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 while it is in vm_state rescued Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'server_id': '6e24f4b7-a043-4e4c-b890-8afc32c415f2', 'body': {'volumeAttachment': {'volumeId': 'ab3d630d-7ca9-4657-866e-05dfabc8d7e0'}}} Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:56:41.394466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 while it is in vm_state rescued Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:56:41.395700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:56:41.396948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:56:41.396948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:56:41.396948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 while it is in vm_state rescued Aug 04 20:56:41.396948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:56:41.398575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Returning 409 to user: Cannot 'attach_volume' instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 while it is in vm_state rescued {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:56:41.399459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b81dd7dc-d882-4265-b925-570a2811b588 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052873 Aug 04 20:56:41.400328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 143/267] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:56:41 2022] POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 20:56:41.418660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:41.419588 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:41.429913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.430688 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.431445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.434015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.434666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.435294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.536662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-70c6eee9-ab7c-412e-84b7-934a88aa5093 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/action" status: 202 len: 0 microversion: 2.1 time: 0.128384 Aug 04 20:56:41.537901 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 125/268] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:56:41 2022] POST /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 20:56:41.546170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:41.547011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:41.553532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.554338 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.554966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.555829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:41.556289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:41.556759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:41.717296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:41.725306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-70c74a42-5bff-437a-8c67-f21ccba2167e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.183555 Aug 04 20:56:41.726414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 144/269] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:41 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:42.748176 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:42.749090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:42.757219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:42.757718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:42.758169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:42.758886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:42.759343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:42.759773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:42.953242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:42.969940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-67ef26ce-569c-4c20-844d-43bca120666a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.226657 Aug 04 20:56:42.976052 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 126/270] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:42 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:43.578914 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ddc604b4-3982-410e-a672-e207adb02f9e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'create', calling method: .version_select at 0x7f2bdaae2ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-758836172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjGlUiVw9JNrsLJKd0xv3yjwlapaXe+v2Pg2tGMbcCReMhYSle1LpUnct86hVVacJAXm5VRPMKJS7RuWc5x+jeqG2l9FzIB/+0CfBgUl9Oj7OX2W7nXnnEkANgYqUZ82w=="}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:43.594514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-ddc604b4-3982-410e-a672-e207adb02f9e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Getting quotas for project 06b449da3f4248579c6a12f07c7f5b55. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:56:43.598590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-ddc604b4-3982-410e-a672-e207adb02f9e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Getting quotas for user c10b35e8364c4789b7a926888f1e7234 and project 06b449da3f4248579c6a12f07c7f5b55. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:56:43.621346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ddc604b4-3982-410e-a672-e207adb02f9e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046202 Aug 04 20:56:43.621964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 145/271] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:56:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:56:43.722951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1083785671", "imageRef": "6f8a138a-b2f0-44e6-90ec-100dcc21ed50", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-758836172", "networks": [{"uuid": "7118c810-68eb-40c1-9dff-e57749f9a7cb"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:56:43.785481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] validate_networks() for [('7118c810-68eb-40c1-9dff-e57749f9a7cb', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:56:43.992790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:43.993474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:44.000141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:44.000668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:44.001159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:44.001856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:44.002313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:44.002735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:44.209454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:44.218119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d395f28f-4902-482f-9d7f-b67a1af7869e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.229367 Aug 04 20:56:44.218935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 146/272] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:43 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:44.225334 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:56:44.225900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:56:44.226381 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:56:44.226790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:56:44.227204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:56:44.237051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:44.237536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:44.237972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:44.238696 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:44.239157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:44.239583 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:44.256814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Getting quotas for project 06b449da3f4248579c6a12f07c7f5b55. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:56:44.260915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Getting quotas for user c10b35e8364c4789b7a926888f1e7234 and project 06b449da3f4248579c6a12f07c7f5b55. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:56:44.274133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:56:44.277360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f8a138a-b2f0-44e6-90ec-100dcc21ed50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:56:44.326288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4390a13b-8088-4f32-aaa9-00ca5be20725 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607204 Aug 04 20:56:44.326937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 127/273] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:56:44.337563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2f9d6ac2-8936-4601-bafb-318ca2087d35 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:44.338169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2f9d6ac2-8936-4601-bafb-318ca2087d35 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:44.346883 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:44.393708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2f9d6ac2-8936-4601-bafb-318ca2087d35 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:44.401590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2f9d6ac2-8936-4601-bafb-318ca2087d35 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1258 microversion: 2.1 time: 0.066903 Aug 04 20:56:44.402210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 147/274] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:44 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:45.244187 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:45.245622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:45.252903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:45.253687 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:45.253837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:45.254544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:45.255001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:45.255527 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:45.423759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:45.424512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:45.431158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:45.431424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:45.431863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:45.433265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:45.434198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:45.434726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:45.435457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:45.439939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6ef604d9-f0ec-4408-b3c5-7e75f6f4bd91 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.199728 Aug 04 20:56:45.441168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 128/275] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:45 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:45.511438 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:45.520467 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-06c36e6a-ccf9-4147-b232-3cfb901bc0ef tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1310 microversion: 2.1 time: 0.101072 Aug 04 20:56:45.521526 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 148/276] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:45 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:46.466488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:46.471183 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:46.491667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:46.504292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:46.505155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:46.507801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:46.510031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:46.518051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:46.549350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:46.551857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:46.577519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:46.578541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:46.579261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:46.580563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:46.581453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:46.582308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:47.043338 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:47.058405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9c030838-6610-47c4-9edd-d2bbee949dd6 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.517710 Aug 04 20:56:47.059058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 149/277] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:46 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:47.073576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:47.096533 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-20d428c8-b277-42f7-a9a2-0a416b17575a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.634728 Aug 04 20:56:47.109524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 129/278] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:46 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:48.086819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:48.088041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:48.097981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:48.099141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:48.099811 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:48.100997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:48.102135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:48.102412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:48.108427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:48.119306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:48.120583 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:48.138875 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:48.139383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:48.140045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:48.140647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:48.141362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:48.142156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:48.362613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:48.381242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d67ca233-4404-4bec-a1e9-745d44edbe70 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.262083 Aug 04 20:56:48.382346 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 130/279] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:48 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:48.503887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:48.513809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-58f81e84-5242-4bb6-9965-fde1c7d1614d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.432551 Aug 04 20:56:48.527823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 150/280] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:48 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:49.412252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:49.413457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:49.421740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:49.422578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:49.423020 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:49.423726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:49.424186 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:49.424634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:49.535282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:49.535990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:49.542092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:49.542678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:49.543142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:49.543863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:49.544314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:49.546317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:49.696177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:49.710730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a9bfc0d-e1be-4754-9efd-f0e456cd323e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.301347 Aug 04 20:56:49.711605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 131/281] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:49 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:49.806238 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:49.817640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a14dd2a4-cb1a-4daf-84cf-ee3499bb245d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.286035 Aug 04 20:56:49.819106 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 151/282] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:49 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:50.734201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:50.735615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:50.743703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:50.744706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:50.746381 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:50.747377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:50.748064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:50.748921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:50.839688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:50.840235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:50.846388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:50.846885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:50.847322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:50.852227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:50.852739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:50.853183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:50.967669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:50.974471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:50.977019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ea54c2c7-07a2-42ec-87d8-a122004a655d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.248004 Aug 04 20:56:50.986485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 132/283] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:50 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:51.037198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:51.045585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4e1d89f5-1252-47b2-8eab-53d41d8823ee tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.210341 Aug 04 20:56:51.046169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 152/284] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:50 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:52.002331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:52.002943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:52.022443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:52.022939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:52.023378 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:52.024083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:52.024562 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:52.024979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:52.066596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:52.067286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:52.074247 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:52.075097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:52.075755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:52.077729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:52.078425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:52.079179 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:52.314412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:52.323193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9808c55c-b510-40bc-b7ec-2faab6c48f29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.324827 Aug 04 20:56:52.326724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:52.359022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 133/285] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:51 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:52.359681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-04fc8510-30e9-4df3-961a-57a17d5f9463 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.274754 Aug 04 20:56:52.376849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 153/286] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:52 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:53.353797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:53.355856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:53.363746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:53.364502 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:53.365157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:53.366059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:53.366723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:53.367446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:53.385581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:53.387245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:53.398973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:53.399384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:53.400277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:53.401768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:53.408035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:53.408875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:53.708174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:53.728377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-76bdbc88-f298-4fbe-a83d-927f2ca5ae21 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.347008 Aug 04 20:56:53.756365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 154/287] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:53 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:53.856268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:53.864087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-384ac748-fc0a-4e85-9668-dc49478dc86d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.521332 Aug 04 20:56:53.865086 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 134/288] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:53 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:54.768305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:54.768946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:54.771156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:54.777106 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:54.777905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:54.778744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:54.780076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:54.780764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:54.781281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:54.889959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:54.890548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:54.894314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:54.895552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:54.903748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:54.904662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:54.905342 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:54.906305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:54.907014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:54.907665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:55.105699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:55.120521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fe020256-65a3-4563-9a2e-ad69f4f3afa0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.350501 Aug 04 20:56:55.132365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 155/289] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:54 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:55.218355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:55.228192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c5814284-2ca4-454e-b4cf-299b4cd2f107 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.342628 Aug 04 20:56:55.228767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 135/290] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:54 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:56.142977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:56.143837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:56.158772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:56.159461 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:56.160022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:56.160846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:56.161381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:56.162078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:56.256250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:56.265198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:56.280422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:56.282253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:56.284996 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:56.287315 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:56.288009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:56.288665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:56.563602 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:56.571494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7790ba32-2c7c-45a2-ba36-9af4491a93fa tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.433131 Aug 04 20:56:56.585493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 156/291] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:56 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:56.616821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:56.639178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-34711839-c1ed-48a1-9a06-94dab49caffb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.384877 Aug 04 20:56:56.640124 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 136/292] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:56 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:57.593585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:57.594960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:57.601660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:57.603186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:57.605111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:57.606172 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:57.607487 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:57.608140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:57.660658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:57.661960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:57.669924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:57.670423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:57.671333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:57.672238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:57.672914 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:57.673514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:57.804758 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:57.814246 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-87abc09f-f5b8-4eee-9462-119bd531fbed tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.225147 Aug 04 20:56:57.815406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 157/293] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:57 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:57.861798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:57.869546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c807cf2-3f46-4cde-b2b8-b226c2ba4824 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.212866 Aug 04 20:56:57.883155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 137/294] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:57 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:56:58.838693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:58.840077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:58.849439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:58.850189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:58.850959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:58.852004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:58.852567 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:58.853319 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:58.891513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:56:58.892119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:56:58.898927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:58.899676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:58.900282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:58.901820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:56:58.902509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:56:58.903144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:56:59.064704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:59.075042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7389ea60-e2c6-45bf-a5e1-45dbf28b6695 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.242753 Aug 04 20:56:59.076331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 158/295] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:58 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:56:59.130766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:56:59.139488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4df4492-e08c-4fd2-8657-57ef69209e6b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.251667 Aug 04 20:56:59.140186 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 138/296] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:56:58 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:00.099906 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:00.101236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:00.113146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:00.114348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:00.115362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:00.116855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:00.117678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:00.118632 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:00.167754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:00.169722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:00.190968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:00.193446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:00.194468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:00.195913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:00.198109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:00.199009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:00.430698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:00.439958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5b150bb8-2187-48c8-9602-cb8cc4c872f7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.347614 Aug 04 20:57:00.456851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 159/297] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:00 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:00.466787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:00.475638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b5ccfbec-9082-4f09-acee-12d24f72a6cd tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.318118 Aug 04 20:57:00.476924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 139/298] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:00 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:01.463598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:01.464236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:01.472332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:01.474375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:01.474993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:01.475925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:01.476746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:01.477503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:01.498765 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:01.499388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:01.510474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:01.513140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:01.513807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:01.514851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:01.515472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:01.516062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:01.929416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:01.932333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:01.937667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5daeb8f-9a14-42e4-a2d6-012157e3e224 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.443805 Aug 04 20:57:01.938497 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 140/299] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:01 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:01.955548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9d0e6993-236d-417d-9447-599326b56671 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.496808 Aug 04 20:57:01.956414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 160/300] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:01 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:02.959044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:02.960454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:02.967753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:02.968614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:02.969063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:02.969773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:02.970234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:02.970666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:02.978067 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:02.979412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:02.987633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:02.989320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:02.990007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:02.991137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:02.992280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:02.992984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:03.317065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:03.328669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d84f00bf-549d-45a8-8b1a-99adf47d5dca tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.373508 Aug 04 20:57:03.343270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 141/301] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:02 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:03.436748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:03.451609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-efc4f458-7b38-4a31-8876-4c9a78b4ca0a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.474231 Aug 04 20:57:03.452528 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 161/302] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:02 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:04.352833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:04.354208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:04.356418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:04.368296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:04.369361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:04.370075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:04.371076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:04.371752 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:04.372430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:04.482023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:04.482743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:04.495838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:04.497592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:04.499133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:04.500148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:04.500948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:04.501744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:04.710095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:04.721685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0fd9c37d-dc5e-4176-a3d4-b439b2d73da6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.372760 Aug 04 20:57:04.742075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 142/303] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:04 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:04.836598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:04.845495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7ed02938-9f92-4e07-a56b-eced1464097a tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.374841 Aug 04 20:57:04.846689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 162/304] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:04 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:05.121828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ca50bb90-ff28-4db6-b247-9b72c49c9742 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Action: 'create', calling method: .version_select at 0x7f2bda3a2d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-468663904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUBgXkgivn0vJAd+D7Aq/bkZZtEzbiwtzoTcCfyWDPDpXbSDBFY/yuEDWMA5s93j6MFfqUjastkVwSxAk7SmTATW5lsvZu6D0zMWbq3jpldHRQY5eeCc/RcBVleH4Gpxw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:05.137896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-ca50bb90-ff28-4db6-b247-9b72c49c9742 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Getting quotas for project a5dee6a2bfb44b53924cf6d76c5fba12. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:57:05.142118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-ca50bb90-ff28-4db6-b247-9b72c49c9742 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Getting quotas for user 6398ec15831f40bfb1b316070a78adba and project a5dee6a2bfb44b53924cf6d76c5fba12. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:57:05.166759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ca50bb90-ff28-4db6-b247-9b72c49c9742 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.224389 Aug 04 20:57:05.167380 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 143/305] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:57:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:05.745792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:05.746600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:05.756153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:05.757282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:05.758286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:05.759170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:05.759662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:05.760090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:05.871108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:05.873414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:05.890852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:05.891577 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:05.892203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:05.893331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:05.894022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:05.894892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:05.913979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:05.924010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-02cd4b54-520b-4a1b-a909-64db8d799a29 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.184622 Aug 04 20:57:05.924963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 163/306] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:05 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:06.102371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:06.112195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90f45cd6-14a4-4de3-814c-a46e06da61ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.247887 Aug 04 20:57:06.112910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 144/307] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:05 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:06.945915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:06.946530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:06.952827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:06.953342 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:06.953786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:06.954469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:06.954968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:06.955333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:07.086017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:07.094524 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a3798b88-555a-4d38-8f5e-3076401272c1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.152387 Aug 04 20:57:07.095090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 164/308] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:06 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:07.133082 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:07.133775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:07.141837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:07.142405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:07.142932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:07.143681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:07.144207 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:07.144739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:07.286057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:07.293957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-24c4e04f-490a-4e0d-a32c-702a80d7f7fc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.164774 Aug 04 20:57:07.294530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 145/309] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:07 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:08.117507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:08.117507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:08.124121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:08.124657 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:08.125098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:08.126073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:08.126727 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:08.129303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:08.315669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:08.317650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:08.325850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:08.326349 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:08.326942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:08.328106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:08.328607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:08.329232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:08.669965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:08.677357 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:08.679955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d6e84cf6-c848-4bf6-a4cd-ef8832480f2a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.567258 Aug 04 20:57:08.681060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 165/310] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:08 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:08.685931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e19bf2c1-0278-4442-a622-dd5f1bcc685d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.374442 Aug 04 20:57:08.687123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 146/311] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:08 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:09.235436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:09.247496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:09.248902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:09.250954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:09.264459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] Creating event network-changed:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 20:57:09.270262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-26264a50-d774-47b3-b060-18cdc0bfb21a req-f5f315b9-642e-4057-aa7d-cff3b15a537d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040029 Aug 04 20:57:09.271260 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 166/312] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:09.703343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:09.703978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:09.710425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:09.710940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:09.711498 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:09.712375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:09.713037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:09.713446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:09.720781 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:09.721547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:09.729070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:09.729562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:09.730001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:09.730702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:09.731161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:09.731588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:09.754448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:09.941211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:09.944167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:09.950944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62c63dc2-7594-4b4e-b360-be5c9b105193 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1510 microversion: 2.1 time: 0.251870 Aug 04 20:57:09.951987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 147/313] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:09 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:09.952799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0f72311f-6bcf-4f4d-b851-dfbeef11e7a1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.236745 Aug 04 20:57:09.953376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 167/314] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:09 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:10.975091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:10.975711 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:10.984004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:10.984004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:10.984655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:10.984655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:10.984655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:10.984906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:10.985377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:10.986417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:10.989056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:10.989541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:10.989974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:10.990686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:10.991096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:11.001836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:11.185599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:11.193242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c045432b-16fa-44bc-b523-63e2cb2484d7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1516 microversion: 2.1 time: 0.223468 Aug 04 20:57:11.193391 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:11.193812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 148/315] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:10 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:11.201841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-321b9106-ba28-42b4-ba72-8d57ced2bab1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.227216 Aug 04 20:57:11.202334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 168/316] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:10 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:12.224681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:12.226059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:12.232760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:12.233254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:12.233696 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:12.234426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:12.234937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:12.235363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:12.374258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:12.381736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b0cd8ee-c5f9-4b02-9027-5fc3613fc6f1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.161831 Aug 04 20:57:12.382293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 149/317] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:12 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:12.568272 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7be57c23-24e4-4656-8499-cfe03f641bd8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: .version_select at 0x7f2bda9a1f70>, body: {"keypair": {"name": "tempest-keypair-1352591874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk0FbGkVr9sSlTJYAesDNaBa1Y5Q8Zrt13O16wUxC8q8VcJRe5Vir9JiUArcn0JLdkgE4+mrAGQXosj9mFlXUPTSSkCZY1VByqm1t2PQo6L4WFo1y5vUSfBcWMEDDpjKA=="}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:12.584062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-7be57c23-24e4-4656-8499-cfe03f641bd8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:57:12.588431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-7be57c23-24e4-4656-8499-cfe03f641bd8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for user 5026c90f0e3d49669c335ef542280409 and project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:57:12.612421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7be57c23-24e4-4656-8499-cfe03f641bd8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047873 Aug 04 20:57:12.613273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 169/318] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:57:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:57:13.404930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:13.405544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:13.411499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:13.412218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:13.412699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:13.413393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:13.413847 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:13.414275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:13.435250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:13.640818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:13.648574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d22453b6-7322-451b-b8c9-b74f7270dba2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.249233 Aug 04 20:57:13.649152 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 150/319] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:13 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:14.035346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-735061353", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cc3f9ac-fe82-4e5a-bf74-470365985e49"}], "security_groups": [{"name": "tempest-securitygroup--1382865178"}], "key_name": "tempest-keypair-1352591874", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:14.152747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] validate_networks() for [('8cc3f9ac-fe82-4e5a-bf74-470365985e49', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:57:14.376061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:14.575510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:57:14.575934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:57:14.576436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:57:14.576849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:57:14.577261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:57:14.586536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:14.587040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:14.587482 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:14.588227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:14.588709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:14.589635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:14.607600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:57:14.611560 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Getting quotas for user 5026c90f0e3d49669c335ef542280409 and project 71b3821ed2f44e848959ac9d2683dab6. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:57:14.622748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:57:14.625046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:57:14.669974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:14.670755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:14.670939 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ac065c19-cd27-4083-879f-5ebeb73e63a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.639816 Aug 04 20:57:14.671582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 170/320] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:57:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:57:14.678220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:14.679161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:14.679718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:14.680531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:14.681078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:14.681599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:14.683377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-825d10d0-e255-4249-a15f-61555e39188f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:14.684213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-825d10d0-e255-4249-a15f-61555e39188f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:14.759666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-825d10d0-e255-4249-a15f-61555e39188f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:14.767423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-825d10d0-e255-4249-a15f-61555e39188f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1245 microversion: 2.1 time: 0.088393 Aug 04 20:57:14.768185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 171/321] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:14 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:14.831771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:14.840375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad0bb806-80b1-4131-80a1-99f6c53ea08e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.174809 Aug 04 20:57:14.841170 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 151/322] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:14 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:15.789691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:15.790211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:15.797878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:15.798370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:15.798920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:15.799511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:15.799971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:15.800421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:15.861960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:15.862898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:15.866075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:15.866779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:15.870930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:15.871496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:15.872014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:15.872871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:15.873420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:15.873916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:15.874235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6bc7f744-0ba4-473f-872f-957df1924118 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.088485 Aug 04 20:57:15.874810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 172/323] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:15 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:16.008725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:16.016939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9f287ba-f155-4e67-9d7a-5fb4064d503c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.158895 Aug 04 20:57:16.017501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 152/324] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:15 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:16.895066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:16.895610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:16.902216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:16.902798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:16.903235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:16.903925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:16.904409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:16.904841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:16.964732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:16.972217 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-dc818306-36ec-4835-89c5-e2aff69bf065 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.081046 Aug 04 20:57:16.972820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 173/325] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:16 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:17.037279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:17.037919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:17.044639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:17.045126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:17.045565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:17.046318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:17.046717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:17.047143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:17.174819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:17.182704 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-298880c7-9ca0-4c3b-b9ee-303b0960514d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.149163 Aug 04 20:57:17.183284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 153/326] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:17 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:17.994570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:17.995153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:18.001334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:18.001812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:18.002245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:18.002928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:18.003376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:18.003795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:18.066073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:18.073491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fea15252-80b7-4a29-84a6-eeea33561c53 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.084779 Aug 04 20:57:18.074043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 174/327] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:17 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:18.204288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:18.204916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:18.211677 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:18.212106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:18.212565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:18.213255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:18.213705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:18.214129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:18.350435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:18.360102 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6284f3f1-3257-4e2b-9967-219339a545c8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.159544 Aug 04 20:57:18.360102 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 154/328] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:18 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:19.094502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:19.095104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:19.101250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:19.101752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:19.102190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:19.102910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:19.103348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:19.103804 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:19.178784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:19.187830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-803c91b7-73e6-4f17-9ed8-3a00cfdf9438 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.097142 Aug 04 20:57:19.188646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 175/329] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:19 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:19.379905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:19.380552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:19.387056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:19.387518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:19.388568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:19.389277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:19.389739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:19.390168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:19.528051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:19.535909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d685140f-3667-422d-89bf-cd597e25ab2b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.159909 Aug 04 20:57:19.536681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 155/330] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:19 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:20.209180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:20.209718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:20.215852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:20.216539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:20.217627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:20.218478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:20.218941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:20.219371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:20.284790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:20.292631 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2a8b706f-89bd-4e67-82b2-08ca0f9e46d2 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.087276 Aug 04 20:57:20.293211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 176/331] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:20 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:20.556963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:20.557564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:20.565049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:20.565527 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:20.565956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:20.566634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:20.567083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:20.567501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:20.696557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:20.704363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a6efe332-2bda-48e6-91db-89d204173740 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.151201 Aug 04 20:57:20.704926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 156/332] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:20 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:21.314695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:21.315318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:21.321098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:21.321573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:21.322004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:21.322675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:21.323121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:21.323535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:21.387402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:21.395453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-09f413e7-8a19-4327-a763-9e2f049e2650 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1297 microversion: 2.1 time: 0.085326 Aug 04 20:57:21.396020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 177/333] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:21 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:21.725008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:21.726506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:21.738673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:21.739574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:21.740260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:21.741312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:21.742005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:21.743060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:21.914204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:21.926066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-693b8030-851a-45b3-96b4-8c8d684df82f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.204722 Aug 04 20:57:21.926786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 157/334] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:21 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:22.422925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:22.423545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:22.431266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:22.431903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:22.432357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:22.433099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:22.433552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:22.434012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:22.718370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:22.728228 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-59698b2e-26da-4d44-b7be-c8c23e3351ab tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.314583 Aug 04 20:57:22.729109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 178/335] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:22 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:22.950952 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:22.951606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:22.958214 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:22.958783 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:22.959423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:22.960131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:22.960677 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:22.961113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:23.210200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:23.219184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2cad14bc-2205-4aa9-9275-52c9107226d0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.273079 Aug 04 20:57:23.220075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 158/336] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:22 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:23.267058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "name": "network-vif-plugged", "status": "completed", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:23.279785 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:23.280619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:23.281152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:23.298596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] Creating event network-vif-plugged:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 20:57:23.304975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-48668ffe-6598-410e-81cd-5651aba722a0 req-6c4d8a60-a608-4c1f-8295-0174cf91b880 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041491 Aug 04 20:57:23.310214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 179/337] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:23.533020 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:23.543802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:23.544425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:23.545582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:23.560615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] Creating event network-changed:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 20:57:23.565746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-38c6fb68-83c4-4ad5-8bd5-db31bf2e5c7f req-1415197d-4fb5-4d91-a0b7-5bfd3752c0a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037555 Aug 04 20:57:23.566356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 159/338] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:57:23.753423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:23.754300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:23.760765 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:23.761257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:23.761698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:23.762410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:23.762866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:23.763290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:24.087712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:24.096464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d26d1f73-d704-4165-b1d3-25b9a59d9f9d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.347388 Aug 04 20:57:24.097028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 180/339] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:23 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:24.241184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:24.242410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:24.250290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:24.250778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:24.251216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:24.251903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:24.252371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:24.252800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:24.400245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:24.408503 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86352151-8ccf-48d1-bd4c-4d18afd2220c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.171283 Aug 04 20:57:24.409613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 160/340] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:24 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:25.117340 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:25.117877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:25.119847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:25.120542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=12 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:25.127069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:25.127554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:25.127990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:25.128717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:25.129167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:25.129589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:25.259551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:25.268143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4723404b-dd8d-4cfb-8c24-d74cf02d8081 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.154707 Aug 04 20:57:25.268736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 181/341] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:25 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:25.430682 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:25.430682 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:25.438085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:25.438703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:25.439266 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:25.440367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:25.441011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:25.441632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:25.583147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:25.590855 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0ed15585-284a-482c-b226-4fbb73449cf2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.164857 Aug 04 20:57:25.591375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 161/342] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:25 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:26.290475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:26.291205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:26.297856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:26.298333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:26.298768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:26.299459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:26.299912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:26.300350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:26.434890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:26.442357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8d7ece2d-0d0d-4db4-b95e-83bcd2913c06 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.155958 Aug 04 20:57:26.442930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 182/343] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:26 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:26.611071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:26.611681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:26.618146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:26.618662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:26.619100 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:26.619792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:26.620250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:26.620707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:26.753159 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:26.760859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-61932d6d-f809-4c94-9464-23c466824fbe tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.153548 Aug 04 20:57:26.761963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 162/344] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:26 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:27.462686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:27.463293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:27.469312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:27.469772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:27.470205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:27.471010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:27.471638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:27.472380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:27.616913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:27.627685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-22e38fce-4ceb-497d-a8f3-e8bcf52421a6 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.168644 Aug 04 20:57:27.628266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 183/345] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:27 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:27.783189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:27.783841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:27.790618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:27.791335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:27.791671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:27.792298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:27.792775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:27.793230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:27.937711 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:27.945282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f3e0aae-ae9a-42d2-8895-94e643b4c670 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.166891 Aug 04 20:57:27.952037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 163/346] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:27 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:28.647958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:28.648519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:28.654441 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:28.654990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:28.655424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:28.656101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:28.656586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:28.657003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:28.782992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:28.790383 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-df4ab32a-a450-4da8-ac7b-09e29aee818c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.146379 Aug 04 20:57:28.790938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 184/347] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:28 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:28.966352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:28.966999 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:28.973494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:28.973984 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:28.974422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:28.975117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:28.975572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:28.975995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:29.149493 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:29.157405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6171bec9-4b9c-44e0-b1dc-d758975504bb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1358 microversion: 2.1 time: 0.194911 Aug 04 20:57:29.160382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 164/348] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:28 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:29.812332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:29.812893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:29.819130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:29.819614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:29.820048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:29.820756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:29.821488 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:29.821912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:29.993681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:30.002270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-17070bd5-7d41-450a-859f-39ea661dc794 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.193983 Aug 04 20:57:30.002847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 185/349] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:29 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:30.179125 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:30.179679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:30.186762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.187259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.187686 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.188412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.188865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.189288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.361781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:30.369151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-329b6760-e544-410d-a6fd-ddfa6b102757 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1547 microversion: 2.1 time: 0.194186 Aug 04 20:57:30.369715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 165/350] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:30 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:30.390723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:30.391442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:30.397465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.397954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.398397 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.399090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.399550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.399977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.562477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:30.570041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4e04579d-bc8d-4e81-827c-f4341d5aa19e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1547 microversion: 2.1 time: 0.183342 Aug 04 20:57:30.570612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 186/351] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:30 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:30.590798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:30.596735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:30.597501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Searching by: {'deleted': False, 'project_id': '06b449da3f4248579c6a12f07c7f5b55'} {{(pid=124350) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 20:57:30.605319 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.605895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.606629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.607361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.607818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.608243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.700874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.multi_cell_list [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124350) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 20:57:30.801351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-da92c95f-c907-4b3f-b4f7-7ce8b45618ae tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214636 Aug 04 20:57:30.808276 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 166/352] 10.222.0.52 () {58 vars in 1125 bytes} [Thu Aug 4 20:57:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:30.816678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:30.817309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:30.823961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.824462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.825002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.825769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:30.826227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:30.826654 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:30.850313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:31.023182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:31.023806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:31.030434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:31.031195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:31.031639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:31.032663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:31.033380 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:31.033820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:31.056771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:31.103693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:31.103693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a4312129-f0a9-45f4-8890-8c52174861a0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1547 microversion: 2.1 time: 0.291908 Aug 04 20:57:31.104291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 187/353] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:30 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1547 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:31.198003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:31.205832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-21f54b79-16b1-4acc-965a-db8b26680b6c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.186559 Aug 04 20:57:31.206716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 167/354] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:31 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:31.580806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "name": "network-vif-plugged", "status": "completed", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:31.590593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:31.591289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:31.591902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:31.605348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] Creating event network-vif-plugged:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 20:57:31.611954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-38622c7f-c90f-4bb8-9203-60d7114e5d3f req-28121abc-edb7-47a2-be1e-b8786e988af7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Aug 04 20:57:31.612604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 188/355] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:32.226646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:32.227199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:32.234201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:32.234687 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:32.235129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:32.235815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:32.236273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:32.236722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:32.371069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:32.379989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aca7d0d1-b260-4170-a17c-dcf371833e67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.157253 Aug 04 20:57:32.380596 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 168/356] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:32 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:33.401463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:33.402147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:33.408983 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:33.409456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:33.409890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:33.410565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:33.411011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:33.411427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:33.661263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:33.671055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5040d64a-58fe-48bc-9e4a-1c6ed8505d1a tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1371 microversion: 2.1 time: 0.273558 Aug 04 20:57:33.671889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 189/357] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:33 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:33.731331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a12f3e3-100b-4cf0-a11d-dad292742058"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:33.733925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:33.740546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:33.741116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:33.741635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:33.742402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:33.742931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:33.743478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:34.291119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a79d544-58de-4c27-abcc-98229c96dc64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563619 Aug 04 20:57:34.291710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 169/358] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:57:33 2022] POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:34.692121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:34.692779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:34.698790 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:34.699324 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:34.699814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:34.700568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:34.701045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:34.701476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:34.838485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:34.846314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2d5d5f40-455a-4c24-86a7-f043fc6cd8f1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1565 microversion: 2.1 time: 0.158045 Aug 04 20:57:34.846879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 190/359] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:34 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:34.868047 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:34.868661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:34.870574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:34.877338 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:34.877826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:34.878264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:34.878954 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:34.879413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:34.879843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:34.961045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-449f588e-751c-4c7f-9bdd-372ac360d85d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097550 Aug 04 20:57:34.961635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 170/360] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 20:57:34 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:36.150039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:36.160224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:36.160730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:36.161165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:36.173019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] Creating event network-changed:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 20:57:36.178364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-1696ffc1-f79a-4843-ab5f-aa1b183aac61 req-8e1b8d5d-3102-4b19-8169-20407ed70f31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Aug 04 20:57:36.179004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 191/361] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:36.391857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-677571038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-468663904", "security_groups": [{"name": "tempest-secgroup-smoke-1163873377"}], "networks": [{"uuid": "5b8c2d48-2ac5-4d49-a013-d7cb77fb58e9"}], "block_device_mapping_v2": [{"uuid": "7a1e6484-449b-49b8-aa63-8f24a33cb015", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:36.573428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] validate_networks() for [('5b8c2d48-2ac5-4d49-a013-d7cb77fb58e9', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:57:37.381675 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:57:37.382181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:57:37.382646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:57:37.383056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:57:37.383515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:57:37.393076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:37.394174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:37.394619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:37.395401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:37.395858 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:37.396280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:37.413740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Getting quotas for project a5dee6a2bfb44b53924cf6d76c5fba12. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:57:37.417704 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Getting quotas for user 6398ec15831f40bfb1b316070a78adba and project a5dee6a2bfb44b53924cf6d76c5fba12. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:57:37.478982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:57:37.481382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a1e6484-449b-49b8-aa63-8f24a33cb015',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:57:37.632268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4016c8e7-9caf-430a-8242-933c19668692 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.245418 Aug 04 20:57:37.638960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 171/362] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:57:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:57:37.647603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a62b15d-e015-4a7d-9d47-10e315135f12 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:37.648299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9a62b15d-e015-4a7d-9d47-10e315135f12 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:37.704797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9a62b15d-e015-4a7d-9d47-10e315135f12 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:37.711646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9a62b15d-e015-4a7d-9d47-10e315135f12 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1087 microversion: 2.1 time: 0.070476 Aug 04 20:57:37.712282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 192/363] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:37 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:38.732622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:38.733873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:38.740115 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:38.740632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:38.741073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:38.741760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:38.742220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:38.742646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:38.804681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:38.812773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90a771be-8269-4592-9b2b-a3a13f1c4178 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1137 microversion: 2.1 time: 0.084498 Aug 04 20:57:38.813331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 172/364] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:38 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:39.833777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:39.834327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:39.840455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:39.840946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:39.841379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:39.842206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:39.843766 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:39.844124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:39.906165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:39.913505 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ffb53b8b-8378-4424-b7b7-69a61d99c7df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1137 microversion: 2.1 time: 0.083674 Aug 04 20:57:39.914066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 193/365] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:39 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:40.935586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:40.936115 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:40.944192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:40.944811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:40.945406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:40.946599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:40.947412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:40.948175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:41.019613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:41.027057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fb3671b0-02bd-4176-a2a4-42ee0a8accae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1137 microversion: 2.1 time: 0.095385 Aug 04 20:57:41.027613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 173/366] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:40 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:42.047454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:42.048428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:42.054661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:42.055148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:42.055588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:42.056274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:42.056755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:42.057182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:42.117426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:42.124897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3c86a14b-06c6-49a6-88c0-58889df333ea tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1129 microversion: 2.1 time: 0.081792 Aug 04 20:57:42.126166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 194/367] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:42 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:43.147504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:43.148118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:43.155012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:43.155806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:43.155944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:43.156644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:43.157061 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:43.157754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:43.222073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:43.230105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3658f737-c94b-4a81-a30a-f0bb2ed0337b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1185 microversion: 2.1 time: 0.086540 Aug 04 20:57:43.230668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 174/368] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:43 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:44.121682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:44.122289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:44.128522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:44.129041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:44.129517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:44.130327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:44.130787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:44.131323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:44.250581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:44.251473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:44.258475 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:44.258968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:44.259416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:44.260118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:44.260608 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:44.261035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:44.349945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:44.358106 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2bf02295-5bf2-4443-9054-83a77f08a62c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1593 microversion: 2.1 time: 0.240338 Aug 04 20:57:44.358625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 195/369] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:44 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1593 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:44.361048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:44.368676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-54e38918-2eab-4401-8f4a-afb7358d0599 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1203 microversion: 2.1 time: 0.122245 Aug 04 20:57:44.369545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 175/370] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:44 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1203 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:45.289081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:45.294222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:45.310857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:45.311335 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:45.312858 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:45.326666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] Creating event network-changed:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 20:57:45.337689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-5b56a341-c0e3-4dcd-be75-1cfd66071270 req-506ca0f0-eee1-40e5-8e81-ab42f6f592be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051769 Aug 04 20:57:45.338548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 196/371] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:45.398887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:45.399636 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:45.408259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:45.409025 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:45.409718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:45.410436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:45.410904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:45.411334 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:45.640747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:45.649533 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eb2a88ca-c114-45c0-a639-d70fcdab1f44 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1271 microversion: 2.1 time: 0.254671 Aug 04 20:57:45.650190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 176/372] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:45 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:46.251393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:46.261226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:46.261885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:46.262142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:46.274048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] Creating event network-changed:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 20:57:46.279846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-4c92fb28-873b-46f1-9266-b50dee442a67 req-94d06f3d-02b5-41d1-8668-68c1b3a7d7a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032591 Aug 04 20:57:46.280797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 197/373] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:46.670700 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:46.671300 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:46.679624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:46.680121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:46.680581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:46.681531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:46.682135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:46.683396 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:46.879168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:46.888141 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7bde95fd-d470-42cc-87b1-4b4152d27dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.221384 Aug 04 20:57:46.889204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 177/374] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:46 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:47.327660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2060246398"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:47.328723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:47.336261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:47.336798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:47.337238 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:47.337930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:47.338385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:47.338844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:47.672080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.network.security_group_api [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Adding security group 392ba0de-3ff9-49ea-b006-8d8854251bf5 to port 932aa5cf-9a6b-4336-b1b8-01061f95dddb Aug 04 20:57:47.709039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:47.911858 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:47.913648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:47.916120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:47.916941 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:47.931455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:47.932016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:47.932661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:47.933715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:47.934225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:47.934862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:48.638489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:48.646317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6ab990a5-8be3-4ed7-9110-09be5154d43a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.740632 Aug 04 20:57:48.646894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 178/375] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:47 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:48.865522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ce3c01e7-c41e-433b-b8e7-403d60e64287 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action" status: 202 len: 0 microversion: 2.1 time: 1.542119 Aug 04 20:57:48.866159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 198/376] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:57:47 2022] POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action => generated 0 bytes in 1544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:57:48.874335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:48.880917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:48.886972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:48.893831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:48.894298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:48.894419 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:48.894741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:48.894865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:48.895173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:48.895444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:48.895890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:48.896310 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:48.906630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] Creating event network-changed:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 20:57:48.912239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-02892392-d39a-414a-9b33-30a7e78b6e5b req-c7640217-4ce0-49ae-9d95-20c4d08c9d7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035574 Aug 04 20:57:48.913160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 199/377] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:49.160507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:49.169793 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-066028ce-58f0-4b46-88eb-8dd6dfd47e17 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1640 microversion: 2.1 time: 0.299266 Aug 04 20:57:49.170419 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 179/378] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:48 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1640 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:49.667740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:49.668545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:49.674964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:49.675510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:49.676156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:49.676954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:49.677415 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:49.677846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:49.849750 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:49.857307 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9dfd8062-68c7-4df9-a07a-e696a8fcd1df tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.193707 Aug 04 20:57:49.857874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 200/379] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:49 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:50.880182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:50.880811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:50.887283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:50.887762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:50.888199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:50.888910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:50.889368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:50.889791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:51.026937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:51.034423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e509349-04f4-4ff4-b8fc-7f85d6c9210d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.160548 Aug 04 20:57:51.035035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 180/380] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:50 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:57:52.055105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:52.055782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:52.061880 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:52.062554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:52.062973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:52.064246 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:52.064723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:52.065143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:52.196936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:52.205189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2b39b713-0938-4ac6-b50d-e3be3a5a016e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.154121 Aug 04 20:57:52.209602 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 201/381] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:52 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:53.226976 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:53.227579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:53.234066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:53.234542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:53.234977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:53.235909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:53.236449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:53.236870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:53.371428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:53.379133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e85342b5-55e8-4f65-8ae1-1139e0fb1e8d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.155977 Aug 04 20:57:53.379698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 181/382] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:53 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:54.400002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:54.400768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:54.407927 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:54.408466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:54.409015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:54.409736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:54.410226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:54.414550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:54.570733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:54.578992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-05b31173-b156-4805-abb0-00503e85663b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.182687 Aug 04 20:57:54.579588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 202/383] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:54 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:55.599843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:55.600493 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:55.608065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:55.608590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:55.609032 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:55.609806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:55.610920 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:55.611439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:55.749031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:55.758079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6ac829ac-009d-4e22-835c-7a5d6bb45b03 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.162964 Aug 04 20:57:55.758661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 182/384] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:55 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:56.778921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:56.779536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:56.785875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:56.786359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:56.786802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:56.787485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:56.787943 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:56.788400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:56.931544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:56.940299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4617ba56-2389-4416-95ab-387a7c227c4d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.165150 Aug 04 20:57:56.940999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 203/385] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:56 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:57.960980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:57.961519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:57.968013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:57.968533 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:57.968972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:57.969710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:57.970165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:57.970643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:58.103074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:58.106577 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:58.112422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-31780ea5-8c9b-4df5-bc4c-21a744dba4d5 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.155382 Aug 04 20:57:58.112992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 183/386] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:57 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:57:58.693359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "name": "network-vif-plugged", "status": "completed", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:57:58.702983 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:58.703420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:58.704706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:58.716274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] Creating event network-vif-plugged:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 20:57:58.722186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-16fb544e-a020-4653-b4c8-40d4c7ed6c9c req-b9afd877-fb9d-44ab-b17a-e1c047d5272b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032485 Aug 04 20:57:58.722897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 204/387] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:57:59.133679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:57:59.134277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:57:59.142535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:59.143009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:59.143436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:59.144110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:57:59.144585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:57:59.145006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:57:59.295224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:57:59.303121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c2f48ea2-5919-4f9c-ab19-2ec9086ebe52 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.174016 Aug 04 20:57:59.303716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 184/388] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:57:59 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:00.323575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:00.324370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:00.330726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:00.331214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:00.331655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:00.332361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:00.332896 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:00.333390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:00.465978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:00.474036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7f4599cd-397a-461b-9763-3a0371e281cd tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1259 microversion: 2.1 time: 0.154715 Aug 04 20:58:00.474600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 205/389] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:00 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:00.805041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:00.805565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:00.811928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:00.812480 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:00.812939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:00.813740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:00.814340 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:00.814770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:00.838405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-14567e95-5b84-4299-8c8f-f9bc0ae808ec tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/ips" status: 200 len: 145 microversion: 2.1 time: 0.037508 Aug 04 20:58:00.838906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 185/390] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 20:58:00 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:01.495052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:01.495664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:01.502237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:01.502721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:01.503160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:01.503853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:01.504312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:01.504764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:01.508769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=79 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:01.639182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:01.646739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-aca28db2-5e0c-450c-95b0-5c5326255d6b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1442 microversion: 2.1 time: 0.155537 Aug 04 20:58:01.647297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 206/391] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:01 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:01.666919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:01.667533 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:01.674143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:01.674620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:01.675060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:01.676001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:01.676485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:01.676915 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:01.809479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:01.817703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cddcf4aa-0403-4881-9f6d-d7059214300a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1442 microversion: 2.1 time: 0.154565 Aug 04 20:58:01.818274 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 186/392] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:01 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:03.755431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:03.764598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:03.765077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:03.765507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:03.778813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] Creating event network-changed:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 20:58:03.783896 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-d1c51aaf-0ffa-440a-8499-073bb6cc0847 req-034630ea-62c0-4b83-ba12-74fb79124538 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Aug 04 20:58:03.784744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 207/393] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:06.758669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897e5746-3bfd-46f1-9de4-93dd28019a24"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:06.761076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:06.762977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:06.768475 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:06.768968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:06.769407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:06.770104 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:06.770561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:06.770985 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:07.064318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fbdc0378-dd1e-41a9-864c-c8a2acac0b0d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309281 Aug 04 20:58:07.064963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 187/394] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:58:06 2022] POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:14.620393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:14.620881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=23 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:14.621349 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=7 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:14.627891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:14.628305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:14.628759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:14.693971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Going to try to stop instance {{(pid=124352) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 20:58:14.741408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0c7a7bc9-a8be-4746-8660-9059ae2cae21 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action" status: 202 len: 0 microversion: 2.1 time: 0.126863 Aug 04 20:58:14.742899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 208/395] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:58:14 2022] POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:58:14.753529 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:14.754938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:14.761825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:14.762385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:14.763314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:14.764020 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:14.764523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:14.765030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:14.915030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:14.924663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-902a656e-375a-4255-8a32-07e618b233ba tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.176773 Aug 04 20:58:14.925289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 188/396] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:14 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:15.945854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:15.946623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:15.953923 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:15.954489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:15.954940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:15.955647 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:15.956111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:15.956571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:16.099690 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:16.108927 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-43116278-4121-40d0-9266-9713903e3e4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.166885 Aug 04 20:58:16.109544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 209/397] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:15 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:17.129495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:17.130109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:17.136632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:17.137117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:17.137558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:17.138242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:17.138700 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:17.139128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:17.279096 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:17.288515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-407707b9-9443-4bcc-99e3-f15760bf3b1f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.162921 Aug 04 20:58:17.289144 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 189/398] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:17 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:18.310071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:18.310694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:18.318024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:18.318024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:18.318475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:18.319190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:18.319639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:18.320091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:18.457663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:18.465782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b609dc7c-ba62-425a-90f1-66ee64129c09 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.159499 Aug 04 20:58:18.466539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 210/399] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:18 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:19.491397 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:19.492031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:19.505142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:19.505648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:19.506086 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:19.507564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:19.507564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:19.507771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:19.662351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:19.671462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a8e83726-871c-44e9-9f6b-e45563331b3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.185494 Aug 04 20:58:19.672220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 190/400] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:19 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:20.248880 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:20.249461 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:20.256120 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:20.256646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:20.257088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:20.257784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:20.258248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:20.258673 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:20.282028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-01b9ea5b-25e6-4b94-8344-d41653e9ced2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/ips" status: 200 len: 152 microversion: 2.20 time: 0.036877 Aug 04 20:58:20.287551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 211/401] 10.222.0.52 () {60 vars in 1289 bytes} [Thu Aug 4 20:58:20 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:58:20.694073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:20.695257 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:20.702049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:20.702544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:20.703031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:20.704367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:20.704836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:20.705267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:20.838620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:20.847249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c164e2da-1d27-496b-8399-2d2308859ff4 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.157633 Aug 04 20:58:20.847810 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 191/402] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:20 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:21.869330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:21.869932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:21.877317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:21.877791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:21.878224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:21.878913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:21.879357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:21.879778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:22.012684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:22.021043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-660a74b9-6b0f-42f9-8f83-64e6dff28f08 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.155616 Aug 04 20:58:22.021611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 212/403] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:21 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:22.347190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:22.347774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:22.354154 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:22.354638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:22.355074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:22.355759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:22.356216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:22.356676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:22.379368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lazy-loading 'flavor' on Instance uuid f9ada2ad-514c-4711-b112-c18aeee76d7c {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:58:22.590808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5cbd5f34-e1c4-44e3-9ce0-05362da48c40 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/action" status: 202 len: 0 microversion: 2.20 time: 0.247929 Aug 04 20:58:22.591552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 192/404] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Aug 4 20:58:22 2022] POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 20:58:22.600396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:22.600951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:22.606874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:22.607369 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:22.607901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:22.608668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:22.609069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:22.609628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:22.743184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:22.751857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:22.753382 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:22.754533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0834713c-a228-473c-a896-da4eb67e85af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.158053 Aug 04 20:58:22.755091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 213/405] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:22 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:23.044210 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:23.045048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:23.052748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.053236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.054576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.054576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.055211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.055639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.196905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:23.197390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:23.198269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:23.205038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.205921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.206483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.207170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.207280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f091858-fe72-4871-8d22-284cd45b7a8b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.167720 Aug 04 20:58:23.207760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 193/406] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:23 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:23.207882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.208711 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.235969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-45063ef1-9244-445b-89c6-1464eb504cf8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/ips" status: 200 len: 150 microversion: 2.1 time: 0.044042 Aug 04 20:58:23.236614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 214/407] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 20:58:23 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:58:23.777955 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:23.778565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:23.785344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.785825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.786264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.786950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:23.787433 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:23.787856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:23.921011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:23.929968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:23.931453 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:23.932633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49136fe0-7935-4364-af79-a35e2249bdfe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.158593 Aug 04 20:58:23.933188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 194/408] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:23 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:24.228489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:24.229031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:24.235521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.235996 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.236469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:24.237155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.237609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.238032 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:24.369511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:24.377690 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-155c74a1-d64c-4677-96ed-8775535d0b82 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.153134 Aug 04 20:58:24.378249 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 215/409] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:24 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:24.640084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f0e2b4-e9ee-490b-a511-d544fca8f4d9"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:24.642997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:24.648921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.649401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.649919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:24.650594 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.651043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.651462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:24.934253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fb81ff34-d54c-4b05-a6ae-cabb734ce45f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298096 Aug 04 20:58:24.934960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 195/410] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:58:24 2022] POST /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:24.957682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:24.958290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:24.964592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.965078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.965512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:24.966201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:24.966649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:24.967074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:25.105045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:25.114300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:25.115826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:25.117008 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a237600e-35c5-4e6f-9f6f-bdda34999f3c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.164711 Aug 04 20:58:25.117558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 216/411] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:24 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:25.399489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:25.400109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:25.407539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:25.408029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:25.408505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:25.409198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:25.409659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:25.410085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:25.414195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:25.541950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:25.550441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-edf24b9e-573c-40ce-a1ff-8ef589609574 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.155179 Aug 04 20:58:25.551277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 196/412] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:25 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:26.138899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:26.139422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:26.145621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:26.146103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:26.146538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:26.147218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:26.147672 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:26.148093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:26.278434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:26.288078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:26.289549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:26.290701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9a7c1b35-048e-430c-bd0a-5d4e3be8242a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.155696 Aug 04 20:58:26.291263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 217/413] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:26 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:26.572541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:26.573088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:26.579821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:26.580301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:26.580757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:26.581445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:26.581918 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:26.582324 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:26.714072 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:26.722949 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e6bb54b8-eb78-47bf-8a78-11dd70cd2661 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.154357 Aug 04 20:58:26.723515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 197/414] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:26 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:27.315766 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:27.316393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:27.322342 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:27.322774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:27.323223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:27.323908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:27.324392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:27.324823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:27.452057 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:27.460651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:27.462151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:27.463309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-83a59d51-dfd3-4b53-adac-2f65d3b5fa50 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.152008 Aug 04 20:58:27.463860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 218/415] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:27 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:27.745147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:27.745770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:27.752854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:27.753333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:27.753759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:27.754435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:27.754889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:27.755330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:27.888193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:27.896268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-21445733-a337-448f-86d8-049c19e1a273 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.154911 Aug 04 20:58:27.897009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 198/416] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:27 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:28.485056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:28.485656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:28.491536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:28.492015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:28.492484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:28.493167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:28.493617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:28.494041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:28.620233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:28.628193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:28.629730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:28.630890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6367849d-a8ad-4a80-b305-1ba8c6d7ba4d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.149781 Aug 04 20:58:28.631443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 219/417] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:28 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:28.918064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:28.918661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:28.925184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:28.925662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:28.926349 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:28.927025 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:28.927473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:28.927892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:29.058845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:29.067398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ad97360-4e0b-40fb-bf79-d2a636edbda1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.153109 Aug 04 20:58:29.067965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 199/418] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:28 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:29.654262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:29.655209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:29.661594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:29.662075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:29.662504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:29.663183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:29.663634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:29.664052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:29.791861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:29.801110 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:29.802708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:29.803922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-25b0686a-9d9c-4eec-a390-9d39804ddff9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.153543 Aug 04 20:58:29.804502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 220/419] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:29 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:30.089208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:30.089749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:30.096758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:30.097233 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:30.097668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:30.098342 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:30.098789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:30.099206 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:30.226762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:30.235059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-01417ae3-5a1a-4d96-ad3b-811ecdd3edcb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1720 microversion: 2.1 time: 0.149731 Aug 04 20:58:30.235674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 200/420] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:30 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:30.827167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:30.827753 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:30.834313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:30.834803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:30.835237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:30.835935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:30.836410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:30.836842 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:30.965343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:30.973394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:30.974889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:30.976038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d6d00e1b-dbe0-4f62-a720-9012f741fded tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.152865 Aug 04 20:58:30.976658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 221/421] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:30 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:31.256253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:31.256878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:31.263311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:31.263883 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:31.264311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:31.265008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:31.265500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:31.265905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:31.401980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:31.410835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-94d0e668-2185-44aa-b8dd-58d0d44316b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1697 microversion: 2.1 time: 0.158422 Aug 04 20:58:31.411405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 201/422] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:31 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:31.431448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:31.437402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:31.437889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:31.438330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:31.460289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Going to try to start instance {{(pid=124352) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 20:58:31.501502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-047ca7c5-5454-4d16-82ea-1e287f8248a3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action" status: 202 len: 0 microversion: 2.1 time: 0.073864 Aug 04 20:58:31.502087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 222/423] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:58:31 2022] POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:58:31.510296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:31.510908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:31.517737 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:31.518228 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:31.518665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:31.519363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:31.519823 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:31.520247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:31.650313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:31.659269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-16dd74c8-9042-429d-a283-8003e00b71f2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1706 microversion: 2.1 time: 0.152892 Aug 04 20:58:31.659837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 202/424] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:31 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1706 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:32.000683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:32.001400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:32.007445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:32.007917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:32.008357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:32.009041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:32.009489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:32.009907 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:32.013958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:32.141626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:32.149437 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:32.150964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:32.152184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ea300450-af38-4d1b-9a09-471c047dfc91 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.156341 Aug 04 20:58:32.152773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 223/425] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:31 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:32.505430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c8c87e2a-a828-403f-ba5e-862289e00609 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: .version_select at 0x7f2bda06cdc0>, body: {"keypair": {"name": "tempest-keypair-1628490583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGi6mQw4ykZSvXvKedwBpraJNw2FH5lIszlG+USgn769dq8iNTWgPi0uXtzrXOMttqSxfHPoN2eogf4mcI0EfRqlF7tcsmOSIDb6zOKivqTkGxSb0eLDm2gUJ/8dLYu3Sw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:32.526524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-c8c87e2a-a828-403f-ba5e-862289e00609 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:58:32.531657 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-c8c87e2a-a828-403f-ba5e-862289e00609 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:58:32.554894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c8c87e2a-a828-403f-ba5e-862289e00609 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053259 Aug 04 20:58:32.555493 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 203/426] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 20:58:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:32.687146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:32.691023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:32.715442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:32.717712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:32.722069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:32.723706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:32.725020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:32.725537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:33.070388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:33.085134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2df48da6-620f-4f81-9dcf-43bf9c1a842a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1706 microversion: 2.1 time: 0.407621 Aug 04 20:58:33.086074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 224/427] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:32 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1706 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:33.176573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:33.177444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:33.183309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:33.183797 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:33.184546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:33.185250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:33.185698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:33.186118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:33.403734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:33.412388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:33.414015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:33.415461 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62bb4275-6ace-4578-8aa6-0c11c204b7d8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.243608 Aug 04 20:58:33.416962 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 204/428] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:33 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:33.905108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1915813128", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fc90a20-030f-4833-b078-8e1884210eeb"}], "security_groups": [{"name": "tempest-securitygroup--768174812"}], "key_name": "tempest-keypair-1628490583", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:34.010924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] validate_networks() for [('2fc90a20-030f-4833-b078-8e1884210eeb', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 20:58:34.107091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:34.107822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:34.114477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.115007 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.115446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.116147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.116632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.117097 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.346658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:34.355168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75ad8da5-f049-4ceb-9d4e-e38fa9823957 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1706 microversion: 2.1 time: 0.252022 Aug 04 20:58:34.355748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 205/429] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:34 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1706 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:34.440254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:34.440990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:34.446904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.447462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.447991 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.448774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.449300 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.449722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.458839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 20:58:34.459322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 20:58:34.459850 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 20:58:34.460328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 20:58:34.460888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 20:58:34.470430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.471020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.471531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.472372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:34.472826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:34.473262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:34.490189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 20:58:34.494323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 20:58:34.506542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 20:58:34.508954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 20:58:34.560168 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-743dffe5-9920-4a39-bba2-257b27f4e0cb tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.659346 Aug 04 20:58:34.567133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 225/430] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 20:58:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 20:58:34.574040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b0877e92-8d58-4407-9ba3-75e8d1b0d3e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:34.575300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b0877e92-8d58-4407-9ba3-75e8d1b0d3e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:34.595421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:34.603458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:34.605167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:34.606622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ea580a45-cf0d-458f-ac11-32aaf174de6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.170304 Aug 04 20:58:34.607171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 206/431] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:34 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:34.633479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b0877e92-8d58-4407-9ba3-75e8d1b0d3e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:34.641594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b0877e92-8d58-4407-9ba3-75e8d1b0d3e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1242 microversion: 2.1 time: 0.073189 Aug 04 20:58:34.642347 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 226/432] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:34 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:35.377286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:35.377928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:35.384640 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.385130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.385572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.386256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.386716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.387187 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.518781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:35.526956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c51f92be-0792-44c0-b371-493ec714ef12 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1710 microversion: 2.1 time: 0.153583 Aug 04 20:58:35.527585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 207/433] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:35 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:35.630959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:35.631471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:35.637408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.637893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.638330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.639019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.639478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.639908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.662286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:35.662992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:35.669126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.669690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.670201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.670969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:35.671423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:35.672554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:35.739118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:35.747496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c8d4e9b8-7acb-47d0-9dc3-0fe76e654557 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1294 microversion: 2.1 time: 0.089024 Aug 04 20:58:35.756267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 208/434] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:35 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:58:35.804931 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:35.813645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:35.815150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:35.816314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0a40309e-1c78-49fa-a33b-5ef90a249658 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.189444 Aug 04 20:58:35.816891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 227/435] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:35 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:36.770388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:36.771159 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:36.778234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:36.778873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:36.779499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:36.780726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:36.781269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:36.781936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:36.842522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:36.843155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:36.849627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:36.850373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:36.851139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:36.851968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:36.852594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:36.853121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:37.049561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:37.057760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8934866f-9676-4970-bf87-e8d9d8b4920c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.291216 Aug 04 20:58:37.058336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 209/436] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:36 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:37.130568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:37.138334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:37.139815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:37.141190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5e7937be-8a0c-4898-aebe-3102720ec9c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.302542 Aug 04 20:58:37.141747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 228/437] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:36 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:37.515650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0", "tag": "5443916c-f8d6-4884-a3e3-a8b1eeaf381b"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:37.521732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:37.529300 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:37.529795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:37.530231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:37.543480 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] Creating event network-changed:5443916c-f8d6-4884-a3e3-a8b1eeaf381b for instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 on hv-cinder-83602 Aug 04 20:58:37.548839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f0c2a5b2-aa32-482b-a331-a759fa8173a2 req-26d1d25c-e7db-4572-9ad1-96cd6406cd3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037436 Aug 04 20:58:37.549977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 210/438] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:38.078909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:38.079535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:38.085877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:38.086547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:38.086988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:38.087684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:38.088143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:38.088619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:38.165800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:38.166496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:38.174621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:38.175121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:38.175564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:38.176574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:38.177113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:38.177582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:38.254206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:38.261812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d021774b-23fd-482a-8836-06d6e2293f06 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.187115 Aug 04 20:58:38.262395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 229/439] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:38 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:38.320484 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:38.329232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:38.330742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:38.331894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f764dfe6-9b23-4f50-9dc4-8fb93821476f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.170381 Aug 04 20:58:38.332487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 211/440] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:38 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:39.284244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:39.285007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:39.292310 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:39.292821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:39.293252 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:39.293930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:39.294378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:39.294798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:39.355173 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:39.355822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:39.363400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:39.363900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:39.364402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:39.365133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:39.365617 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:39.366071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:39.466431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:39.474946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bc47542b-26c7-4978-8280-fd03eb8c019d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.195398 Aug 04 20:58:39.475522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 230/441] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:39 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:39.524006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:39.532749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:39.534230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:39.535429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bf2b2087-6cd2-48e1-b6d0-0c1704f5b1cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.184207 Aug 04 20:58:39.535925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 212/442] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:39 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:40.496206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:40.496855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:40.503414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:40.503897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:40.504463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:40.505159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:40.505619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:40.506046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:40.561601 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:40.563352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:40.572504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:40.573243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:40.573912 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:40.574973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:40.575680 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:40.576363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:40.652366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:40.661075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6c4cb986-803d-47ec-8308-299fe816b1b3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.168576 Aug 04 20:58:40.661662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 231/443] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:40 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:40.744218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:40.753633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:40.755107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:40.756281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a16895d1-45e2-4b75-b10a-02d750c2d9cb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.201135 Aug 04 20:58:40.756870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 213/444] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:40 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:41.684235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:41.684893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:41.691456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:41.691951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:41.692418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:41.693136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:41.693594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:41.694024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:41.779345 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:41.779917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:41.787155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:41.787642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:41.788065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:41.788787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:41.789242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:41.789664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:41.809651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:42.067281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:42.074820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4ac5bd2e-a2ad-42e3-ab6f-50f51212c4fc tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.394581 Aug 04 20:58:42.075394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 232/445] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:41 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:42.094936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:42.103110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:42.104853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:42.106259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a1653faa-ac06-47b8-bcb8-e45961ee1a4e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.330932 Aug 04 20:58:42.106989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 214/446] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:41 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:42.998413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "name": "network-vif-plugged", "status": "completed", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:43.009693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:43.010421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:43.011026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:43.023832 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] Creating event network-vif-plugged:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:58:43.029276 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-daa04ff9-e173-495e-802e-76317049cad5 req-75cc85ae-0a30-4cb3-b7e4-786a8cd1d0e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Aug 04 20:58:43.030192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 233/447] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:43.097415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:43.098005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:43.099981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:43.106223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:43.106717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:43.107150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:43.107845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:43.108289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:43.108829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:43.131065 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:43.131898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:43.138421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:43.139113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:43.139959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:43.141442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:43.142091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:43.142520 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:43.302960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:43.310433 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-075ee621-cba4-435e-98a6-26df7f7423a9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.217154 Aug 04 20:58:43.311006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 215/448] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:43 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:43.324546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:43.333438 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:43.334951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:43.336116 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8c083133-08da-4c78-bae9-d18056665151 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.209541 Aug 04 20:58:43.336700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 234/449] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:43 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:44.332279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:44.332906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:44.339291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:44.339805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:44.340244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:44.340950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:44.341404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:44.341828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:44.358576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:44.359293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:44.365282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:44.365769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:44.366208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:44.366895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:44.367347 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:44.367769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:44.480886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:44.548651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:44.552690 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:44.556303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c9d51a9e-e0fc-4bfc-89c3-9071bfdf014d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.228863 Aug 04 20:58:44.556926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 216/450] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:44 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:44.564934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:44.566414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:44.567614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7bc89d18-aa66-462c-9673-469937f6adbc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.212876 Aug 04 20:58:44.568163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 235/451] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:44 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:45.409860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0", "name": "network-vif-plugged", "status": "completed", "tag": "5443916c-f8d6-4884-a3e3-a8b1eeaf381b"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:45.420476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:45.422243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:45.422710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:45.434105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] Creating event network-vif-plugged:5443916c-f8d6-4884-a3e3-a8b1eeaf381b for instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 on hv-cinder-83602 Aug 04 20:58:45.439087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-61860e5a-dd7c-47b9-9c8b-84d18f9185eb req-3b7e04d8-05ad-45fe-b5e6-1a9ec79f1cad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Aug 04 20:58:45.439680 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 217/452] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:45.577896 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:45.578481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:45.580390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=8 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:45.581535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:45.586903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:45.587538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:45.587811 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:45.588527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:45.588976 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:45.589423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:45.591550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:45.592326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:45.601147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:45.601646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:45.602091 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:45.602848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:45.603311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:45.603939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:45.845005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:45.852498 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-60bd3e7c-06c9-4c49-bf6c-419c48f4847e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.278675 Aug 04 20:58:45.853065 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 236/453] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:45 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:45.861934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:45.870036 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:45.871519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:45.872697 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49643fa1-3716-48b8-82b2-8f203f4205bf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.286136 Aug 04 20:58:45.873252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 218/454] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:45 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:46.873843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:46.874924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:46.880872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:46.881355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:46.881789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:46.882471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:46.882926 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:46.883350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:46.896476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:46.897083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:46.903399 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:46.903888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:46.904327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:46.905044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:46.905888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:46.906725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:47.083402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:47.090161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:47.090813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b1f1a4a9-7cea-4df2-84ec-b14d9677220f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.220860 Aug 04 20:58:47.091389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 237/455] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:46 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:47.098664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:47.100244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:47.101520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8df4be33-0cce-44ae-9b16-f46e5199f10c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.208917 Aug 04 20:58:47.102126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 219/456] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:46 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:48.112929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:48.113544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:48.119525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:48.120079 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:48.120546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:48.121245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:48.121702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:48.122132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:48.125560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:48.126158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:48.132476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:48.132955 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:48.133385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:48.134066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:48.134514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:48.134930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:48.318796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:48.326280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-13476e64-e74d-4911-9ff5-32d2eb656d65 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1367 microversion: 2.1 time: 0.217929 Aug 04 20:58:48.327065 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 238/457] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:48 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:48.330087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:48.338105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:48.339692 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:48.340958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b80dc54-ccc1-4f9d-b8f5-ff7889525fa6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1746 microversion: 2.20 time: 0.220069 Aug 04 20:58:48.341516 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 220/458] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:48 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:49.346868 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:49.347484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:49.353641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.354126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.354567 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.355255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.355715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.356140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.364715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:49.365320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:49.371658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.372151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.372620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.373312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.373768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.374824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.559464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:49.567684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:49.568696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-84252390-da27-4ced-beb1-66a0c6713272 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1558 microversion: 2.1 time: 0.225479 Aug 04 20:58:49.569619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 239/459] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:58:49 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:58:49.577639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:49.579325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:49.580818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9ff50ec8-bbdc-4fb0-a4a6-775864a68b45 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.219950 Aug 04 20:58:49.597468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 221/460] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:49 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:49.597750 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:49.598269 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:49.604312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.604824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.605262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.605949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:49.606404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:49.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:49.695228 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3f657cd5-1305-4309-b9e0-bde67bb16622 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100965 Aug 04 20:58:49.695820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 240/461] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 20:58:49 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 20:58:50.609962 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:50.611099 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:50.627540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:50.628406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:50.629065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:50.630247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:50.631819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:50.633529 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:50.762866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0", "tag": "5443916c-f8d6-4884-a3e3-a8b1eeaf381b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:58:50.782012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:50.782423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:50.782866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:50.795752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] Creating event network-changed:5443916c-f8d6-4884-a3e3-a8b1eeaf381b for instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 on hv-cinder-83602 Aug 04 20:58:50.801679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-1d414bf8-5f8b-4d5c-9351-b637a840c486 req-2f2de118-ab44-45b4-b6cb-2a2eaeeae9ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042141 Aug 04 20:58:50.802947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 241/462] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:58:50.834786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:50.847809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:50.849705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:50.851076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-430656aa-e351-4444-9fb9-b770e775d200 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.247447 Aug 04 20:58:50.851689 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 222/463] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:50 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:51.878779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:51.880196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:51.887257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:51.888085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:51.889167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:51.890297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:51.890824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:51.891274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:52.084059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:52.094165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:52.095616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:52.096714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-041d5526-13fd-492f-a9c8-5b0635b58a38 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.223386 Aug 04 20:58:52.097627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 242/464] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:51 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:53.121323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:53.122418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:53.129126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:53.130012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:53.130458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:53.131198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:53.131690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:53.132122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:53.273389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:53.286824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:53.288919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:53.290112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e926631e-75b1-4951-a0b2-90c384f5671b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.172888 Aug 04 20:58:53.291137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 223/465] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:53 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:54.315081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:54.315726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:54.322657 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:54.323392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:54.323857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:54.324751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:54.325415 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:54.325835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:54.331064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:54.469592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:54.478016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:54.479495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:54.480679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f6148cbf-53aa-478a-84dc-112cec4305ef tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.170161 Aug 04 20:58:54.481225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 243/466] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:54 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:55.503526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:55.504820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:55.513565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:55.514338 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:55.515396 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:55.516496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:55.517269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:55.518598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:55.663829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:55.672796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:55.674298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:55.675477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b8b4d6a-f22d-46eb-a9ce-b3e8c7d406af tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.176202 Aug 04 20:58:55.676542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 224/467] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:55 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:56.701272 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:56.703396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:56.711215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:56.712000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:56.712797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:56.713885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:56.714546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:56.715068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:56.855489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:56.864525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:56.866140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:56.867303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-10829c2f-a995-46c4-b511-49b628bb4f36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.170064 Aug 04 20:58:56.868410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 244/468] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:56 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:58:57.892552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:57.893164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:57.909062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:57.909439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:57.910059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:57.910942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:57.911626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:57.912054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:58.112555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:58.123697 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:58.130666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:58.132526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-27827893-f77c-449a-90f5-2ce92e83a888 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.244999 Aug 04 20:58:58.138602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 225/469] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:57 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:58:59.156910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:58:59.157630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:58:59.164371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:59.165309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:59.165850 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:59.166617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:58:59.167146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:58:59.167666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:58:59.333792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:59.344394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:59.346833 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:58:59.348655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e83913fe-cb18-4a61-85ac-aaa65489c417 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.196416 Aug 04 20:58:59.349978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 245/470] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:58:59 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:00.374269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:00.375111 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:00.381328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:00.381806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:00.382244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:00.382934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:00.383387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:00.383809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:00.747089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:00.756131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:00.757673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:00.758837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-11b0a831-9844-4821-933f-7201cee63a67 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1741 microversion: 2.20 time: 0.389008 Aug 04 20:59:00.759404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 226/471] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:00 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1741 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:01.782213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:01.782863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:01.788995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:01.789502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:01.789944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:01.790637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:01.791099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:01.791536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:01.920326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:01.928993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:01.930481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:01.931627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-738eb188-0d03-4aee-a192-4414ff0fbd25 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1723 microversion: 2.20 time: 0.153684 Aug 04 20:59:01.932189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 246/472] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:01 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:02.956149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:02.956742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:02.963121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:02.963605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:02.964046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:02.964763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:02.965212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:02.965632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:03.100509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:03.108573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:03.110082 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:03.111245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a6ad550-cdfb-4d85-b754-d9ef36538804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1723 microversion: 2.20 time: 0.159957 Aug 04 20:59:03.111814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 227/473] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:02 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:03.439339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "name": "network-vif-unplugged", "status": "completed", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:03.448691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:03.449177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:03.449616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:03.462152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] Creating event network-vif-unplugged:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:59:03.467382 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-cd38e744-65ee-4371-bb94-493ee3b991ca req-61da893e-2589-4b0d-9785-782a81d36aed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032436 Aug 04 20:59:03.468768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 247/474] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:59:04.134158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:04.134798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:04.142291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.142789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.143223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.143922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.144400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.144831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.275785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:04.284615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:04.286140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:04.287817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a049df05-9260-40c9-8edc-027ba9788b27 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1666 microversion: 2.20 time: 0.157456 Aug 04 20:59:04.288632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 228/475] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:04 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:04.311668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a0ee9d3-d8a6-4e9a-aee3-f968cc980f80"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:04.314119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:04.320792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.321318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.321823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.322604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.323108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.323494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.607784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0d246656-fb23-472b-bfb0-4ad7eaadea1e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300452 Aug 04 20:59:04.609011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 248/476] 10.222.0.52 () {62 vars in 1364 bytes} [Thu Aug 4 20:59:04 2022] POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 20:59:04.729312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:04.729929 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:04.736256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.736778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.737217 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.737904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.738365 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.738792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.781595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124350) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 20:59:04.850817 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ce808d9e-e113-4b56-b0f0-75254f66effd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/action" status: 202 len: 0 microversion: 2.20 time: 0.125583 Aug 04 20:59:04.851429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 229/477] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Aug 4 20:59:04 2022] POST /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 20:59:04.859697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:04.860491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:04.866612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.867096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.867535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:04.868219 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:04.868706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:04.869139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:05.007980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:05.018026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:05.019579 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:05.020759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-40c158e5-ee93-47bf-b94d-8d2fa3e6a991 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1752 microversion: 2.20 time: 0.165006 Aug 04 20:59:05.021314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 249/478] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:04 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:06.043681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:06.044203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:06.051893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:06.052412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:06.052853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:06.053553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:06.054015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:06.054432 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:06.189913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:06.193619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:06.201367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:06.203126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:06.204373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e419439d-93e9-4987-8133-612112d72e6f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1754 microversion: 2.20 time: 0.165219 Aug 04 20:59:06.204945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 230/479] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:06 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:07.229281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:07.229821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:07.236404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:07.236878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:07.237309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:07.237981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:07.238429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:07.238844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:07.371827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:07.380552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:07.382108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:07.383334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d814b607-a793-4c53-a018-187e2fe6ee30 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.158395 Aug 04 20:59:07.383906 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 250/480] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:07 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:08.406996 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:08.408311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:08.410922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:08.417062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:08.417551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:08.417990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:08.418685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:08.419141 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:08.419566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:08.595073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:08.615611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:08.617290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:08.618588 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-750c9914-465d-478a-8dbc-ce119ff6dde9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.215984 Aug 04 20:59:08.619590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 231/481] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:08 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:09.643410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:09.644238 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:09.650222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:09.650716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:09.651151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:09.651998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:09.652447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:09.652879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:09.792871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:09.802059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:09.803596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:09.804740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f8987f52-7ddc-4885-8b91-9f159fd13664 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.165947 Aug 04 20:59:09.805292 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 251/482] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:09 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:59:10.827315 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:10.828012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:10.834409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:10.834894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:10.835328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:10.836016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:10.836509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:10.836932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:10.981880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:10.991253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:10.992760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:10.993903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1d442c33-63ec-425d-90c6-857bb71846e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.170774 Aug 04 20:59:10.994459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 232/483] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:10 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:12.018640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:12.019431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:12.025536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:12.026027 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:12.026464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:12.027167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:12.027620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:12.028043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:12.168466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:12.177585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:12.179109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:12.180274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f56b1268-e849-4c46-b801-61a5215e0a93 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.167238 Aug 04 20:59:12.181100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 252/484] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:12 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:13.203068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:13.203705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:13.210590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:13.211078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:13.211515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:13.212209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:13.212714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:13.213135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:13.351242 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:13.360750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:13.362277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:13.363470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-de1bb035-b9b2-4d56-9380-a2a4e9987a44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.164382 Aug 04 20:59:13.364051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 233/485] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:13 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:14.386825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:14.387435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:14.394688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:14.395999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:14.396469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:14.397179 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:14.397635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:14.398061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:14.535387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:14.544603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:14.546341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:14.547592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e1bd31d2-0310-4c96-ad1f-6643793937a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.165214 Aug 04 20:59:14.548244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 253/486] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:14 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:15.571065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:15.572018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:15.578600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:15.579089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:15.579523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:15.580227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:15.580716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:15.581139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:15.718311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:15.726748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:15.728265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:15.729457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0438518f-3f44-4e92-b360-25d2f0c65368 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.162327 Aug 04 20:59:15.730012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 234/487] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:15 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:16.755092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:16.756329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:16.758354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=36 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:16.763674 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:16.765073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:16.765672 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:16.766374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:16.766825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:16.767243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:16.902718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:16.911726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:16.913253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:16.914421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b4ac21d8-5d2e-41e1-a720-a523f4bca751 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.166237 Aug 04 20:59:16.914975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 254/488] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:16 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:17.940422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:17.941828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:17.949571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:17.950045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:17.950474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:17.951239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:17.951741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:17.952323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:18.086809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:18.097436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:18.098984 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:18.100368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fbb68e0b-ea8e-4545-9880-6a0a83dd6f8a tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.165357 Aug 04 20:59:18.108924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 235/489] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:17 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:18.148492 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:18.150748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:18.156947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:18.157424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:18.157852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:18.158524 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:18.158971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:18.159388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:18.234998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4ca6d32b-3a11-4c72-8cc2-1798c3dd2cf5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action" status: 202 len: 0 microversion: 2.1 time: 0.090044 Aug 04 20:59:18.235544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 255/490] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:59:18 2022] POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:59:18.244487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:18.245124 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:18.251756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:18.252238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:18.252712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:18.253393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:18.253849 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:18.254273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:18.413784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:18.423325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ebad5653-bf79-4160-8662-de168fc76561 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.182468 Aug 04 20:59:18.423948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 236/491] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:18 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:19.124861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:19.125572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:19.131912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:19.132431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:19.132872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:19.133587 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:19.134041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:19.134466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:19.270435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:19.274160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:19.281082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:19.282592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:19.283759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-62e07774-5c85-4020-bec8-8043ab5b5dfc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.164364 Aug 04 20:59:19.284531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 256/492] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:19 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:19.445824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:19.446542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:19.454622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:19.455117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:19.455557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:19.456295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:19.456811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:19.457267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:19.609160 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:19.618268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dc8093a5-e6ac-46c7-850e-7886fc2a5321 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.176057 Aug 04 20:59:19.619449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 237/493] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:19 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:20.308047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:20.308645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:20.315443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:20.315922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:20.316376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:20.317062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:20.317518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:20.317940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:20.456127 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:20.465614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:20.467705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:20.472999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-32e2be64-04d2-4658-a5e0-ddfffe7804ff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.166043 Aug 04 20:59:20.472999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 257/494] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:20 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:20.641047 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:20.641619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:20.648103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:20.648623 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:20.649064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:20.649768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:20.650234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:20.650657 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:20.802726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:20.812287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-874ebc63-69f3-43ec-a59d-eb602b5e41ea tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.176045 Aug 04 20:59:20.813101 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 238/495] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:20 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:21.492909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:21.493539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:21.500241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.500767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.501207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.501903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.502357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.502778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.646817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:21.655142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:21.656675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:21.657834 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3b6b5df9-39eb-4dcb-a55b-5d72db3df22f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.168984 Aug 04 20:59:21.658388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 258/496] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:21 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:21.799473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8c3738e-47ea-47b9-9159-3038a8f4ba49"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:21.802264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:21.808938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.809416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.809859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.810561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.812275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.812741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.833833 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:21.834478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:21.840843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.841322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.841751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.842439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:21.843088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:21.843508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:21.995738 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:22.005971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-96a86a43-1ff7-4b4d-9158-13e8041bf112 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.176190 Aug 04 20:59:22.006899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 259/497] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:21 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:22.681327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:22.682007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:22.688370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:22.688870 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:22.689333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:22.690017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:22.690472 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:22.690897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:22.824151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:22.833825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:22.835323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:22.836508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-20d2cee5-98a3-40aa-bb52-1ba24958757e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.159124 Aug 04 20:59:22.837071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 260/498] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:22 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:59:23.027362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:23.027965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:23.034049 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:23.034515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:23.034946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:23.035628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:23.036080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:23.036549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:23.177325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:23.185256 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bab56323-5164-40ed-94da-a8bc4718048c tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.161722 Aug 04 20:59:23.186429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 261/499] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:23 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:23.859460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:23.860083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:23.866814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:23.867303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:23.867745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:23.868706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:23.869207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:23.869640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:24.064763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:24.073340 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:24.075023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:24.076724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0349d7cc-2d72-4954-b494-975d583e3759 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.220968 Aug 04 20:59:24.077275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 262/500] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:23 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:59:24.207490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:24.208005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:24.214433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:24.214967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:24.215456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:24.216207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:24.216729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:24.217831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:24.372129 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:24.381433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8971eeb4-b368-4580-9440-9bf3256c8db9 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.177797 Aug 04 20:59:24.382004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 263/501] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:24 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:25.099816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:25.100525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:25.106628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:25.107108 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:25.107752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:25.108462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:25.108918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:25.109331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:25.278326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:25.286859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:25.288449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:25.289611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b70a5def-2899-491a-a120-30561d0b41ae tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.193691 Aug 04 20:59:25.290165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 264/502] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:25 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:59:25.321131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-96e68071-71c4-4c35-b706-46c9b91b70ba tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.526165 Aug 04 20:59:25.321929 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 239/503] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 20:59:21 2022] POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments => generated 194 bytes in 3528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:59:25.402902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:25.403510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:25.410221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:25.410708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:25.411150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:25.411846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:25.412305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:25.412758 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:25.555476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:25.564363 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8cf56c51-de65-4807-8de4-56bb6f0892bd tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.165285 Aug 04 20:59:25.564942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 265/504] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:25 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:26.314778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:26.315380 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:26.323966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:26.324586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:26.324935 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:26.325655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:26.326673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:26.327102 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:26.530174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:26.538819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:26.540326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:26.541512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7ebdbfa0-10da-4b0a-9de9-1c25d717d0bb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.231651 Aug 04 20:59:26.542178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 240/505] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:26 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 20:59:26.585616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:26.586320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:26.592395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:26.592884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:26.593334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:26.594092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:26.594483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:26.594909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:26.736686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:26.744655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e87c760d-f5d9-478f-9d1c-e71026665817 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1750 microversion: 2.1 time: 0.162876 Aug 04 20:59:26.745223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 266/506] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:26 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:27.565159 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:27.565770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:27.572281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:27.572804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:27.573229 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:27.573936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:27.574392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:27.574816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:27.730891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:27.739373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:27.740902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:27.742060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46b1986d-610d-4581-878d-495bd8674374 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.180990 Aug 04 20:59:27.742619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 241/507] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:27 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:27.767103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:27.767703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:27.773604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:27.774082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:27.774512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:27.775186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:27.775639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:27.776059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:27.918707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:27.927603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e361f133-fa41-49a5-a03b-d3031d9ff9a3 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.165036 Aug 04 20:59:27.928164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 267/508] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:27 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:28.766084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:28.766764 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:28.773256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:28.773738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:28.774197 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:28.774922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:28.775444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:28.775874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:28.908862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:28.917220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:28.918735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:28.919942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-843a8252-3da9-495e-a01c-10088e065a9d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.158593 Aug 04 20:59:28.920530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 242/509] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:28 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:28.949671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:28.950285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:28.957158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:28.957643 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:28.958081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:28.958770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:28.959232 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:28.959658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:29.100880 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:29.109019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ffc4564e-18b8-447c-bc01-d9a936a073c7 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.163249 Aug 04 20:59:29.109581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 268/510] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:28 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:29.943515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:29.944130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:29.950672 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:29.952238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:29.952717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:29.953419 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:29.953876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:29.954306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:30.087421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:30.096511 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:30.098012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:30.099205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4a209b31-5747-4dd5-9f27-4bba7397c980 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.159802 Aug 04 20:59:30.099762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 243/511] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:29 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:30.129746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:30.130380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:30.136379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:30.136887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:30.137388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:30.138120 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:30.139104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:30.139590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:30.282351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:30.290456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0fded7b1-3c68-4b39-b81a-44245bb9a779 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.164591 Aug 04 20:59:30.291042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 269/512] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:30 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:31.122166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:31.123308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:31.130178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:31.130761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:31.131203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:31.131924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:31.132409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:31.132888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:31.268035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:31.276431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:31.277990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:31.279182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-024ba3fa-d257-4a9e-b821-e831c7696d79 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.161047 Aug 04 20:59:31.279755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 244/513] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:31 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:31.313149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:31.313761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:31.319596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:31.320083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:31.320560 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:31.321248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:31.321700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:31.322131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:31.462594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:31.471120 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-26700145-c26e-4ee3-b392-30664d870e10 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.162482 Aug 04 20:59:31.471882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 270/514] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:31 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:32.063158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 20:59:32.063335 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 20:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 20:59:32.302166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:32.302780 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:32.309209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:32.309693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:32.310133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:32.310964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:32.311422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:32.311854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:32.445469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:32.455534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:32.457305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:32.458925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f5833e1-d4d6-49d7-a0ac-eddcb567bbbe tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.160590 Aug 04 20:59:32.459951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 245/515] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:32 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:32.492806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:32.493415 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:32.500617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:32.501100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:32.501539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:32.502224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:32.502673 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:32.503096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:32.646508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:32.654502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-677ec98e-eeb3-49dc-96fb-9498398720f2 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.165570 Aug 04 20:59:32.655117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 271/516] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:32 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:33.484487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:33.485084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:33.491481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:33.491968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:33.492421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:33.493107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:33.493561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:33.493987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:33.498556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:33.630359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:33.639870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:33.641428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:33.642813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3305f941-7b1b-4f34-af7e-4ff1acc5253e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.163182 Aug 04 20:59:33.643439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 246/517] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:33 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:33.675621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:33.676553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:33.682395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:33.682899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:33.683332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:33.684013 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:33.684496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:33.684920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:33.827387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:33.835372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8876d6a6-cd08-426e-96e0-9889718574b1 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.163572 Aug 04 20:59:33.835928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 272/518] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:33 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:34.666031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:34.666642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:34.673179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:34.673661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:34.674099 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:34.674784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:34.675241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:34.675664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:34.839025 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:34.848837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:34.850418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:34.851507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f74e3422-7f4f-4f51-a655-9279477245f3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.189365 Aug 04 20:59:34.852218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 247/519] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:34 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:34.856647 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:34.857444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:34.863642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:34.864198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:34.864676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:34.865388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:34.865836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:34.866257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:34.886099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:35.011352 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:35.020556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8e58db99-5a11-4a3d-bbdb-101d047bd55d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.168132 Aug 04 20:59:35.021117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 273/520] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:34 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:35.874710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:35.875303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:35.882119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:35.882609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:35.883049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:35.883738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:35.884192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:35.884646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.028364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:36.030897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:36.031437 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:36.038293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.038780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.039544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.040499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.040961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.041388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.041790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:36.043333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:36.044535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-082af411-09f0-4b20-8e34-ffb2842bfc29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.173937 Aug 04 20:59:36.045545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 248/521] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:35 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:36.050204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:36.051248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:36.057443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.057931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.058604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.059509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.060204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.060667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.066813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lazy-loading 'flavor' on Instance uuid b064df63-ae6f-4ea7-8c62-8750bedfde15 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:59:36.197732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-80ea9b14-d684-4776-a027-bf18ac57210b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/action" status: 200 len: 32 microversion: 2.1 time: 0.173904 Aug 04 20:59:36.198322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 274/522] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:59:36 2022] POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 20:59:36.209098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:36.209802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:36.214146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:36.216505 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.217626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.218150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.218989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:36.219588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:36.220122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:36.226028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-410911e4-c461-4f0e-9158-82850eee96b8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.179219 Aug 04 20:59:36.226626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 249/523] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:36 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:36.438126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:36.446055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5c7b3232-d3b7-47fc-b7a6-40cb2703da05 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.241412 Aug 04 20:59:36.446622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 275/524] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:36 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:37.067570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:37.068175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:37.074850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.075330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.075768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.077487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.077950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.078379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.212549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:37.220945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:37.222439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:37.223593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-581cdc3b-c975-4b31-b360-6e60b7a8a104 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.159901 Aug 04 20:59:37.224146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 250/525] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:37 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:37.246914 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:37.247518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:37.254516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.254999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.255435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.256167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.256654 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.257079 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.400139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:37.408728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7a47c6ab-1e85-46dc-b706-963dc844ca01 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.165661 Aug 04 20:59:37.409289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 276/526] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:37 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:37.469108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:37.469706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:37.475572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.476053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.476531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.479617 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.480095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.480703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.614551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:37.622814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-78b5d3aa-ad1c-41d9-a163-0d6d3c84f7af tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.158292 Aug 04 20:59:37.623976 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 251/527] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:37 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:37.802426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "name": "network-vif-plugged", "status": "completed", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:37.812595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:37.813081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:37.813519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:37.824640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] Creating event network-vif-plugged:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 20:59:37.830167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-632f663a-cd44-4fd1-b37e-233afabc4663 req-61e35926-241b-4e2d-b290-dd7796f35844 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031650 Aug 04 20:59:37.830857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 277/528] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 20:59:38.247051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:38.247591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:38.254804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.255282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.255712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.256414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.256884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.257286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.393891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:38.402153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:38.403637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:38.405006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d8bfe1e-84ce-4c15-b4ae-1e54fd5ac643 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.161714 Aug 04 20:59:38.405566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 252/529] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:38 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:38.431732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:38.432454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:38.439752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.440242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.440718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.441406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.441860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.442283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.644977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:38.645605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:38.647421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=44 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:38.650570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:38.652841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.653320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.653804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.655771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:38.656238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:38.656695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:38.659257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-42484c30-ab53-4ea1-8aa1-810036f002da tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.232350 Aug 04 20:59:38.659827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 278/530] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:38 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:38.790015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:38.799087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-360986b7-91fc-492f-9018-ac499a78a9e4 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.158027 Aug 04 20:59:38.799647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 253/531] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:38 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:39.428798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:39.429406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:39.436578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.437159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.437586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.438255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.438713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.439208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.574071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:39.583301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:39.584841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:39.586023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fff418c8-bc04-429f-b66f-51dde3abc1eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.161386 Aug 04 20:59:39.586595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 279/532] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:39 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:39.681481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:39.682089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:39.689505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.689992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.690437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.691122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.691582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.692009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.820534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:39.821268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:39.827530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.828042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.828614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.829381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:39.829905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:39.830399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:39.835704 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:39.843903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eebfad84-77d3-4720-95cc-d1d9b74a70cb tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1755 microversion: 2.1 time: 0.166291 Aug 04 20:59:39.844509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 254/533] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:39 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:39.961917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:39.970073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-97349319-6be5-425e-a2d7-7bbda88e0374 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.153759 Aug 04 20:59:39.970643 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 280/534] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:39 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:40.709621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:40.710227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:40.716167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:40.717374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:40.717809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:40.718495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:40.718951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:40.719376 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:40.855008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:40.863956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:40.865516 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:40.865910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:40.866510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:40.866691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b29de72-0fe0-49c9-8c03-a20846464bfa tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.261600 Aug 04 20:59:40.867255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 255/535] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:40 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:40.873862 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:40.874384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:40.874819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:40.875506 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:40.875958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:40.876399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:40.991045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:40.991742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:40.998255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:40.998872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:40.999248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:40.999943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:41.000420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:41.000846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:41.022332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:41.030236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c0e4e428-670d-444f-8730-6e25361a6528 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1758 microversion: 2.1 time: 0.168022 Aug 04 20:59:41.030806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 281/536] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:40 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:41.134832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:41.142914 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a73aa64e-2cdd-474d-9854-0188fa542b75 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.155723 Aug 04 20:59:41.143492 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 256/537] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:40 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 20:59:41.890401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:41.891147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:41.897145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:41.897631 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:41.898069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:41.898758 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:41.899218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:41.899640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:42.036018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:42.044572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:42.046364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:42.047536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fb761cb1-2de5-4699-b3ae-0fca3bfc9771 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1810 microversion: 2.20 time: 0.161795 Aug 04 20:59:42.048105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 282/538] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:41 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:42.266293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:42.266900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:42.272802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:42.273288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:42.273720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:42.274407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:42.274862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:42.275292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:42.414693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:42.423628 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2383fa86-12b1-44cf-8a69-36926dc6c0bb tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.263346 Aug 04 20:59:42.424196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 257/539] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:42 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:43.070633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:43.071232 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:43.078223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:43.078713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:43.079153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:43.079841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:43.080299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:43.080751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:43.209068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:43.217490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:43.218988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:43.220133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-58adb5ff-a891-4cd5-806a-e78029a166eb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1797 microversion: 2.20 time: 0.153410 Aug 04 20:59:43.220718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 283/540] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 20:59:43 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 20:59:43.445136 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:43.445648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:43.452183 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:43.452701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:43.453143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:43.453842 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:43.454303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:43.454756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:43.583241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:43.591575 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86d5a97d-80ff-45ca-9956-2e3d1f9f2527 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.150391 Aug 04 20:59:43.592149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 258/541] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:43 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:44.613333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:44.613940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:44.619906 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:44.620484 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:44.620929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:44.621618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:44.622082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:44.623060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:44.755530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:44.764037 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0c3b71b7-44d4-4ab9-a21b-453855329e3b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.153979 Aug 04 20:59:44.764857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 284/542] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:44 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:45.785413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:45.786007 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:45.792431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:45.792918 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:45.793358 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:45.794039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:45.795104 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:45.795846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:45.922904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:45.931136 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-db721ebd-324b-46ae-bcf3-64739d0d7610 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.149675 Aug 04 20:59:45.931700 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 259/543] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:45 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:46.953909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:46.954459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:46.956428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=62 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:46.961728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:46.962208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:46.962642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:46.963322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:46.963769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:46.964187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:47.097018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:47.104979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-017fb9f1-492e-4285-8315-d8ba20a93fa0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.155740 Aug 04 20:59:47.105538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 285/544] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:46 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:48.127185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:48.127698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:48.134216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:48.134689 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:48.135116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:48.135788 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:48.136233 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:48.136676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:48.267474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:48.275508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d6c23b39-8b26-47a1-8501-1a1551a0a31c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.152202 Aug 04 20:59:48.276080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 260/545] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:48 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:49.296714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:49.297321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:49.303555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:49.304038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:49.304516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:49.305206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:49.305667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:49.306096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:49.437243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:49.444975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f3f355ef-a331-4439-8da3-920f8bc96009 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.152549 Aug 04 20:59:49.445527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 286/546] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:49 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:50.467145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:50.467693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:50.474435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:50.474928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:50.475369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:50.476069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:50.476628 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:50.477053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:50.611139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:50.619083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-72d7a04d-17a7-4e99-a746-19001570c5a8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.156557 Aug 04 20:59:50.619650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 261/547] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:50 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:51.640475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:51.641112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:51.647047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:51.647530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:51.647970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:51.648677 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:51.649132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:51.649557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:51.779345 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:51.787165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-17db07cd-1027-4a8e-9966-2c9f6e68ea83 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.150527 Aug 04 20:59:51.787721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 287/548] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:51 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:52.350490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:52.351118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:52.358271 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:52.358763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:52.359199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:52.359919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:52.360407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:52.360836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:52.485635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:52.490311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lazy-loading 'services' on Instance uuid cd4eef31-8b60-4328-adde-046f701b8d15 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 20:59:52.603977 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b82bd39-c653-436e-9b75-52e0895e0e5f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments/897e5746-3bfd-46f1-9de4-93dd28019a24" status: 202 len: 0 microversion: 2.1 time: 0.357941 Aug 04 20:59:52.604665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 262/549] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 20:59:52 2022] DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments/897e5746-3bfd-46f1-9de4-93dd28019a24 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:59:52.812967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:52.813581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:52.819442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:52.819956 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:52.820413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:52.821125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:52.821586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:52.822018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:52.954901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:52.958339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:52.963624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-12374a11-63a0-44d2-89f7-04913b49ee4d tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.155160 Aug 04 20:59:52.964193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 288/550] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:52 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:53.987073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:53.987674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:53.993827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:53.994303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:53.994733 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:53.995407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:53.995859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:53.996277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:54.127464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:54.135390 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7635f917-35df-4dbe-9d7e-cf7df8009dcc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.153947 Aug 04 20:59:54.135944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 263/551] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:53 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:55.156600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:55.157242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:55.164495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:55.164975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:55.165408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:55.166085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:55.166531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:55.166948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:55.341246 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:55.349759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2c8a9707-92e5-4d74-8dce-de1a5b94652b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.197216 Aug 04 20:59:55.350320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 289/552] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:55 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:55.841591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:55.847995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:55.848518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:55.848966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:55.912883 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Going to try to stop instance {{(pid=124350) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 20:59:55.958123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d68db606-6c90-4908-b57d-1d14bbe81b15 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action" status: 202 len: 0 microversion: 2.1 time: 0.120522 Aug 04 20:59:55.958742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 264/553] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:59:55 2022] POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 20:59:55.969046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:55.969665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:55.976830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:55.977771 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:55.978343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:55.980139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:55.981187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:55.982357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:56.118078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:56.127073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8e9c116b-ba37-49b7-934a-d2d062cb14aa tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.164041 Aug 04 20:59:56.127650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 290/554] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:55 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:56.371893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:56.372626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:56.379275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:56.379791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:56.380236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:56.380960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:56.381514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:56.381986 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:56.521451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:56.530746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b36da438-8c4e-42eb-831f-12f403c41e6f tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1736 microversion: 2.1 time: 0.163300 Aug 04 20:59:56.531326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 265/555] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:56 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:57.150504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:57.151102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:57.157617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.158098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.158532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.159215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.159663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.160085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.293534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:57.302607 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ece45b28-60a0-4282-948d-c36a7f7c353b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.155910 Aug 04 20:59:57.303177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 291/556] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:57 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:57.551799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:57.552445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:57.558787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.559266 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.560284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.561215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.562105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.562105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.697669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:57.706374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-61c785e3-82b4-477f-8279-f022d21bad4e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1716 microversion: 2.1 time: 0.158607 Aug 04 20:59:57.706938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 266/557] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:57 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:57.770443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:57.771010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:57.777877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.778286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.778943 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.779642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.780103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.780563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.925486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] HTTP exception thrown: Cannot 'detach_volume' instance b064df63-ae6f-4ea7-8c62-8750bedfde15 while it is in vm_state rescued Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Request method failure captured: Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments/b8c3738e-47ea-47b9-9159-3038a8f4ba49 HTTP/1.1 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIQNppqY5vBQmsM6c9o9J2g_L-miWgWjHtRPAL8pPfldZGlx-4byeGzbkV0np4zmqu6mbeZmw6uHp4EAxOtKZ0M7SNMI2CLd3OCkUfEo1Rm1w2147YPcI3vtQaT2l2lvssKcblCafFWxPsgIxp4h9jDuNkHa1R-dNUyzR13XzNSCU0 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 20:59:57.928457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71b3821ed2f44e848959ac9d2683dab6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71b3821ed2f44e848959ac9d2683dab6"}]}] Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 5026c90f0e3d49669c335ef542280409 Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 20:59:57.930074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Cannot 'detach_volume' instance b064df63-ae6f-4ea7-8c62-8750bedfde15 while it is in vm_state rescued Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'server_id': 'b064df63-ae6f-4ea7-8c62-8750bedfde15', 'id': 'b8c3738e-47ea-47b9-9159-3038a8f4ba49'} Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 20:59:57.930916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b064df63-ae6f-4ea7-8c62-8750bedfde15 while it is in vm_state rescued Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b064df63-ae6f-4ea7-8c62-8750bedfde15 while it is in vm_state rescued Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 20:59:57.932206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Returning 409 to user: Cannot 'detach_volume' instance b064df63-ae6f-4ea7-8c62-8750bedfde15 while it is in vm_state rescued {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 20:59:57.933537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c76f8bb7-6659-4cc9-8eb0-2a811ad45581 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments/b8c3738e-47ea-47b9-9159-3038a8f4ba49" status: 409 len: 152 microversion: 2.1 time: 0.164186 Aug 04 20:59:57.933537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 292/558] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 20:59:57 2022] DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments/b8c3738e-47ea-47b9-9159-3038a8f4ba49 => generated 152 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 20:59:57.944003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 20:59:57.944564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:57.953372 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.954100 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.954784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:57.955577 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:57.956038 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:57.956506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:58.021181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0349f8f5-1f57-49e8-b4a4-b22be8b0e024 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/action" status: 202 len: 0 microversion: 2.1 time: 0.083251 Aug 04 20:59:58.022447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 267/559] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 20:59:57 2022] POST /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 20:59:58.031831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:58.032456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:58.039874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:58.040405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:58.040884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:58.042566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:58.043033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:58.043464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:58.274466 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:58.284517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e0d07218-0278-4d34-8b15-e51a7fedf482 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1724 microversion: 2.1 time: 0.257605 Aug 04 20:59:58.285625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 293/560] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:58 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:58.324890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:58.327084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:58.333573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:58.334062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:58.334501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:58.335194 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:58.335793 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:58.336219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:58.557018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:58.566356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc22f71b-731e-4964-b514-5ab91203a327 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.245882 Aug 04 20:59:58.566940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 268/561] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:58 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:59.307194 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:59.307808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:59.314556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:59.315044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:59.315483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:59.316200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:59.316667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:59.317100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:59.447812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:59.456359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2e35e01a-92a8-40a2-bce1-6950a5853c56 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1724 microversion: 2.1 time: 0.153176 Aug 04 20:59:59.457130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 294/562] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:59 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 20:59:59.589000 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 20:59:59.589877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 20:59:59.596332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:59.596930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:59.597365 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:59.598048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 20:59:59.598489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 20:59:59.598906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 20:59:59.727059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 20:59:59.734647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86ffb805-37c4-4edb-afdb-9573fd1a877a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.149660 Aug 04 20:59:59.735211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 269/563] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 20:59:59 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:00.477699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:00.478295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:00.485468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:00.485956 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:00.486394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:00.487081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:00.487536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:00.487961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:00.621494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:00.630458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-44ab3ec8-0abe-478c-9a4b-63751796f53c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1724 microversion: 2.1 time: 0.156616 Aug 04 21:00:00.631099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 295/564] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:00 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:00.756251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:00.756832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:00.763438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:00.763931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:00.764385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:00.765069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:00.765517 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:00.765933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:00.899215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:00.906772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8bd6fc8e-cbba-4719-95f4-14c2633946e9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.154457 Aug 04 21:00:00.907340 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 270/565] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:00 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:01.651795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:01.652424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:01.659114 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:01.659595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:01.660029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:01.660744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:01.661200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:01.661622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:01.797600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:01.805686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b9efff9b-5077-4050-bf3f-d1f90bf8d31b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1724 microversion: 2.1 time: 0.157763 Aug 04 21:00:01.806244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 296/566] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:01 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:01.928081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:01.928807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:01.935474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:01.935964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:01.936438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:01.937155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:01.937612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:01.938029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:02.067133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:02.074673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0256d4a6-9b1c-416c-b395-4647a6b8739c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.150725 Aug 04 21:00:02.075913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 271/567] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:01 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:02.828737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:02.829295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:02.835123 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:02.835601 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:02.836058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:02.836760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:02.837217 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:02.837633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:02.964237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:02.972551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0b40c810-e3fb-41ac-bd7a-fdf95ead47d1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1730 microversion: 2.1 time: 0.148386 Aug 04 21:00:02.973109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 297/568] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:02 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:02.993149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:02.993732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:03.001406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:03.001895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:03.002336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:03.003033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:03.003505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:03.003928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:03.086030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4364f951-5c8f-4b2b-a40f-016651bd6278 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096757 Aug 04 21:00:03.086658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 272/569] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 21:00:02 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:03.097386 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:03.098072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:03.104135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:03.104647 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:03.105329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:03.106030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:03.107055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:03.107485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:03.343282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:03.350762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5640a541-647e-40d6-867c-38431e043779 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.257213 Aug 04 21:00:03.351503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 298/570] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:03 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:04.266503 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:04.277482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:04.277986 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:04.278961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:04.290606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] Creating event network-changed:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 21:00:04.296979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e93568f2-9a9a-4306-a9da-bd7902ad3186 req-b0a59703-af8e-4866-9a04-7671ea170524 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034944 Aug 04 21:00:04.297598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 273/571] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:04.373427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:04.374043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:04.380422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:04.380918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:04.381370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:04.382073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:04.382533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:04.382960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:04.599092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:04.606066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ffbcab52-50fe-4561-b4a3-5c49960560b6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.236669 Aug 04 21:00:04.606644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 299/572] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:04 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:05.629391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:05.630074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:05.636108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:05.636616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:05.637056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:05.638487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:05.638956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:05.639364 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:05.769374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:05.776900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-265fabe5-acf3-4402-9c6c-d91845550a78 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.152128 Aug 04 21:00:05.777408 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 274/573] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:05 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:06.311595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:06.321009 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:06.321486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:06.321915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:06.333044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] Creating event network-changed:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 21:00:06.338033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-2fe9e15c-3183-4215-a133-e2f95cc2f50e req-722ce23e-8be5-4212-a6ca-24af787874da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Aug 04 21:00:06.338602 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 300/574] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:06.799757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:06.800412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:06.808137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:06.808593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:06.809058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:06.809921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:06.810384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:06.810884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:07.023221 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:07.030884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5f8e4676-6288-4497-8ca4-8e7c202d5794 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.235281 Aug 04 21:00:07.031459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 275/575] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:06 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:08.052093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:08.052665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:08.058895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:08.060237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:08.060919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:08.061616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:08.062073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:08.062496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:08.193206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:08.200991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f91e0645-b22c-494a-990f-2d50ec50fbbd tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.153473 Aug 04 21:00:08.201545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 301/576] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:08 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:09.222951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:09.223587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:09.226355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=46 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:09.232581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:09.233070 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:09.233513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:09.234208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:09.234667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:09.235094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:09.370966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:09.378614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5e2b41b3-d79e-44b6-960d-29f3a0b4cc5a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.159797 Aug 04 21:00:09.379186 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 276/577] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:09 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:10.399299 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:10.399844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:10.406511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:10.406996 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:10.407436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:10.408179 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:10.408673 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:10.409097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:10.544533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:10.552709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-db513fd6-6744-475c-b3a0-57542ae748c5 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.157429 Aug 04 21:00:10.553298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 302/578] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:10 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:11.577770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:11.578384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:11.585181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:11.585663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:11.586239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:11.586782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:11.587259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:11.587864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:11.721792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:11.725368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:11.730056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bb63c168-ecf2-4c5c-8660-f6310aa9a624 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.156245 Aug 04 21:00:11.730683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 277/579] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:11 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:12.752807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:12.753325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:12.759691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:12.759924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:12.760314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:12.761028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:12.761482 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:12.761904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:12.895377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:12.903040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-32e580dc-3636-4376-9b43-d24902ce0406 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.154100 Aug 04 21:00:12.904182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 303/580] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:12 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:13.925524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:13.926310 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:13.934855 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:13.935681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:13.936132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:13.939743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:13.939743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:13.939743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:14.074564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:14.084875 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46f126b0-44ae-4c2c-b95a-b738d9fec03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.163642 Aug 04 21:00:14.085463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 278/581] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:13 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:15.105548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:15.106660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:15.112806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:15.113291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:15.113752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:15.114494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:15.114994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:15.115448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:15.247531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:15.255301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b4d238cf-60db-454f-acf6-f7b4d60dafe9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.153550 Aug 04 21:00:15.256101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 304/582] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:15 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:16.277030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:16.277710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:16.284885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:16.285399 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:16.285845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:16.286554 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:16.287015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:16.287443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:16.421826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:16.429813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-294b108d-2d21-4ac6-9440-c0f66a652d02 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1674 microversion: 2.1 time: 0.156604 Aug 04 21:00:16.430379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 279/583] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:16 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:17.451436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:17.452069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:17.454001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=40 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:17.459264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:17.459739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:17.460169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:17.460879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:17.461328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:17.461745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:17.591900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:17.599678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bbece292-1058-42b9-be7a-5e631246e19b tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1651 microversion: 2.1 time: 0.152181 Aug 04 21:00:17.600243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 305/584] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:17 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:17.620548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:17.627524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:17.628011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:17.628481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:17.650070 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Going to try to start instance {{(pid=124350) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 21:00:17.695051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-29ea9d85-148d-4ace-a77f-b218419164b7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action" status: 202 len: 0 microversion: 2.1 time: 0.078233 Aug 04 21:00:17.695649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 280/585] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 21:00:17 2022] POST /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:17.704563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:17.705112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:17.711279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:17.711834 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:17.712384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:17.713074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:17.713538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:17.714009 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:17.718416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:17.888779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:17.896710 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3478c9fd-680f-4de4-83fb-365190e01c44 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1660 microversion: 2.1 time: 0.196795 Aug 04 21:00:17.897517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 306/586] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:17 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1660 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:18.919191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:18.919804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:18.927347 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:18.927839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:18.928357 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:18.929055 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:18.929510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:18.929934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:19.064090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:19.071812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2d7462eb-185a-491b-848c-32b42d802cce tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1660 microversion: 2.1 time: 0.157326 Aug 04 21:00:19.072394 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 281/587] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:18 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1660 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:20.100976 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:20.101585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:20.108703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:20.109197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:20.109636 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:20.110348 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:20.110802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:20.111225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:20.243726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:20.251903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-94b2df93-7524-44a2-8615-5e00e95d8d3a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1664 microversion: 2.1 time: 0.154706 Aug 04 21:00:20.252474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 307/588] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:20 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:33.426325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=11 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:33.427410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:33.478974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:33.479467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:33.486081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.486558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.486989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.487671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.488119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.488565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.511057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ca1cc5b7-0041-4e0b-8d33-d338ff575f6e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/ips" status: 200 len: 150 microversion: 2.1 time: 0.090343 Aug 04 21:00:33.511598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 282/589] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:00:33 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:33.523765 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f0e2b4-e9ee-490b-a511-d544fca8f4d9"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:33.526132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:33.528137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=5 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:33.529463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=10 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:33.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.535816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.536250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.536966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.537416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.537833 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.617605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: POST /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/os-volume_attachments HTTP/1.1 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 74 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:00:33.619302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {"volumeAttachment": {"volumeId": "01f0e2b4-e9ee-490b-a511-d544fca8f4d9"}} Aug 04 21:00:33.620957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'server_id': '0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0', 'body': {'volumeAttachment': {'volumeId': '01f0e2b4-e9ee-490b-a511-d544fca8f4d9'}}} Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:00:33.621904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:33.623665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 400 to user: Invalid volume: volume 01f0e2b4-e9ee-490b-a511-d544fca8f4d9 is already attached to instances: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-253ee754-83b2-4ded-b543-0f86f61c65f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101086 Aug 04 21:00:33.625255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 308/590] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:00:33 2022] POST /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:00:33.630146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:33.630644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:33.636805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.637288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.638267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.639546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.640006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.640469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.667095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:00:33.743218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62e51155-1b8e-4885-b6b6-7965d48bf495 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 204 len: 0 microversion: 2.1 time: 0.116421 Aug 04 21:00:33.744357 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 283/591] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:00:33 2022] DELETE /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:00:33.753121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:33.753746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:33.760438 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.760924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.761359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.762040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:33.762493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:33.764165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:33.892297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:33.899737 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e200e8b5-e912-4dd7-bc39-c9ab30221368 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1682 microversion: 2.1 time: 0.150499 Aug 04 21:00:33.900296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 309/592] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:33 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:34.923193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:34.923808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:34.930296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:34.930778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:34.931216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:34.931911 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:34.932391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:34.932824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:35.113668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:35.121463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b57d4868-9b9d-4c8d-a73e-d4a58c1f0cb0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1682 microversion: 2.1 time: 0.203154 Aug 04 21:00:35.122049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 284/593] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:34 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:36.143334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:36.143882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:36.149787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:36.150265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:36.150697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:36.151390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:36.151870 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:36.152300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:36.698232 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:36.706358 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3de49c59-7519-428e-9c56-b582b403914c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1682 microversion: 2.1 time: 0.567009 Aug 04 21:00:36.706934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 310/594] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:36 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1682 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:37.229546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0", "name": "network-vif-deleted", "tag": "5443916c-f8d6-4884-a3e3-a8b1eeaf381b"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:37.239993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:37.240591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:37.241098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:37.256907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] Creating event network-vif-deleted:5443916c-f8d6-4884-a3e3-a8b1eeaf381b for instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 on hv-cinder-83602 Aug 04 21:00:37.263438 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0be86739-aa35-47b5-9604-14469170c6f9 req-4f1313de-be82-4a97-82a8-44dde16db6e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098109 Aug 04 21:00:37.268252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 285/595] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:37.729396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:37.730917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:37.738152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:37.738977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:37.739769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:37.740905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:37.741843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:37.742767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:37.810073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:37.810642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:37.811153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:37.811682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'fault' on Instance uuid 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:00:37.859621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:37.866980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-56c2d19e-fdb7-4d9b-843c-8cc9c5217a0c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 200 len: 1332 microversion: 2.1 time: 0.141685 Aug 04 21:00:37.880904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 311/596] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:37 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:38.889841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:38.890545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:38.896760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:38.897255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:38.897703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:38.898393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:38.898855 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:38.899286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:38.912386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 HTTP/1.1 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:00:38.914041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:00:38.915637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0'} Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:00:38.916490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:00:38.917884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:38.919746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:00:38.919746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cbdaa1ae-0d1e-48ef-9d10-36d2f3750251 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 404 len: 111 microversion: 2.1 time: 0.030505 Aug 04 21:00:38.919746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 286/597] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:38 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:00:38.925200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8714d668-e5c9-4776-9697-e900c382cdc5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '.version_select at 0x7f2bda8f2ca0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:38.949083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8714d668-e5c9-4776-9697-e900c382cdc5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628490583" status: 202 len: 0 microversion: 2.1 time: 0.027668 Aug 04 21:00:38.949660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 312/598] 10.222.0.52 () {58 vars in 1221 bytes} [Thu Aug 4 21:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628490583 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:39.273072 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:39.273615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:39.280046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.280572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.281017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.281718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.282175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.282802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.306673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lazy-loading 'flavor' on Instance uuid 31aff8d0-643a-43ac-b774-b9efab7310e6 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:00:39.387309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-813b52f5-630b-4f63-ac71-ff1ac04b9cae tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "POST /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6/action" status: 202 len: 0 microversion: 2.1 time: 0.117816 Aug 04 21:00:39.389377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 287/599] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 21:00:39 2022] POST /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:39.397999 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:39.398925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:39.407971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.409033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.409680 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.410650 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.411179 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.411831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.609492 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:39.616961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b18604f9-53de-4557-9b14-42c2783e9a5c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.222980 Aug 04 21:00:39.617529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 313/600] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:39 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:39.778908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:39.779155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:39.785606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.786181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.786625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.787321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.787772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.788282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.876004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'services' on Instance uuid ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:00:39.947832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-09df28bc-7d00-42cb-bf8e-e51e5c8e279e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments/01f0e2b4-e9ee-490b-a511-d544fca8f4d9" status: 202 len: 0 microversion: 2.1 time: 0.173325 Aug 04 21:00:39.948493 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 288/601] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:00:39 2022] DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments/01f0e2b4-e9ee-490b-a511-d544fca8f4d9 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:39.957003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:39.959107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:39.965064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.966143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.966634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.967709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:39.968169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:39.968619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:39.999010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-91093f3c-a31e-4a22-9381-7768cdb2b04a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 04 21:00:39.999606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 314/602] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:00:39 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:00:40.639826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:40.640547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:40.646734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:40.647218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:40.647653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:40.648330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:40.648809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:40.649231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:40.788330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:40.796383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5deaab3d-7c17-4155-8cb0-f41b8c346dd8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.161442 Aug 04 21:00:40.797027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 289/603] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:40 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:41.011405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:41.014326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:41.020266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:41.020777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:41.021248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:41.021934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:41.022399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:41.022823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:41.051403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c8e95ce7-46e3-417a-a697-c2dcc0dc5ab5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Aug 04 21:00:41.051881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 315/604] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:00:41 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:41.819023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:41.819587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:41.826336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:41.826816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:41.827245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:41.827924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:41.828398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:41.828816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:41.958606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:41.967087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e91fe925-62ae-45b1-94f3-1de707e49407 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.151719 Aug 04 21:00:41.967650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 290/605] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:41 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:42.064157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:42.067291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:42.073414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.073894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.074330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.075041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.075485 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.075911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.103981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e0c91700-5189-46cc-ab93-a6c46023f0e7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043860 Aug 04 21:00:42.104569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 316/606] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:00:42 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:00:42.167642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:42.168149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:42.174476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.174967 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.175407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.176393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.176856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.177286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.203711 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:00:42.279452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b7bcce86-197b-4949-863f-596446d6ab5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 204 len: 0 microversion: 2.1 time: 0.115355 Aug 04 21:00:42.280178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 291/607] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:00:42 2022] DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:00:42.288577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:42.289181 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:42.295668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.296149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.296610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.297296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.297749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.298172 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.431309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:42.439722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9d2890f8-3477-42eb-8a9a-3d17a15003a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1679 microversion: 2.1 time: 0.155086 Aug 04 21:00:42.440294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 317/608] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:42 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:42.988538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:42.989614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:42.996063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.996632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.997078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:42.997770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:42.998230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:42.998650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:43.129933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:43.137970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-894832cd-4d86-4706-8d8c-a006c5c5f0a7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.153083 Aug 04 21:00:43.138287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 292/609] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:42 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:43.461915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:43.462633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:43.468859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:43.469362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:43.469890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:43.470531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:43.471091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:43.471567 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:43.600064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:43.608417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7da7f936-749f-46b4-913d-1142409428c1 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1679 microversion: 2.1 time: 0.150404 Aug 04 21:00:43.609006 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 318/610] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:43 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:44.159479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:44.160127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:44.166789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:44.167279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:44.167776 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:44.169082 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:44.169848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:44.169969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:44.378189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:44.385917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3dfb0eec-6b43-4a9e-b08f-6ec491e2aa24 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.230695 Aug 04 21:00:44.386501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 293/611] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:44 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:44.629508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:44.630120 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:44.636122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:44.636714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:44.637163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:44.638409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:44.639083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:44.639515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:44.723705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:44.736431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-077ad0a2-c57f-420e-9971-7e44a330c9e0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 200 len: 1612 microversion: 2.1 time: 0.110775 Aug 04 21:00:44.738425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 319/612] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:44 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 1612 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:44.770276 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1d56ce-6efb-434e-a0cd-ff779d42d4b1", "name": "network-vif-deleted", "tag": "6740c24c-2bad-4b5c-9c91-33db23f3d429"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:44.784098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:44.785130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:44.785738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:44.792933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:44.803298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] Creating event network-vif-deleted:6740c24c-2bad-4b5c-9c91-33db23f3d429 for instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 on hv-cinder-83602 Aug 04 21:00:44.808928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-6548e2b1-65ad-493c-8526-6d8f880fa330 req-37b00dd0-1b49-41e5-82f1-c1325a562f53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048397 Aug 04 21:00:44.811100 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 294/613] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:45.419839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:45.420477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:45.426983 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:45.427511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:45.427947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:45.428679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:45.429134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:45.429554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:45.580967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:45.588994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-474a60f7-f74b-42f9-bd23-09cc9e24c27f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.172961 Aug 04 21:00:45.589590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 320/614] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:45 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:45.760117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:45.760841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:45.768360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:45.768846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:45.769281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:45.769973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:45.770427 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:45.770845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:45.785004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 HTTP/1.1 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:00:45.786681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:00:45.788132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'ef1d56ce-6efb-434e-a0cd-ff779d42d4b1'} Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:00:45.789040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:00:45.790610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:00:45.791910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:00:45.791910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dc81f4b2-e090-4f41-b8d9-5424c510c1a7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 404 len: 111 microversion: 2.1 time: 0.032663 Aug 04 21:00:45.791910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 295/615] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:45 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:00:45.797988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e6e323d2-fae7-44ec-80b0-92c8d1f2e3fa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '.version_select at 0x7f2bda90edc0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:45.817899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e6e323d2-fae7-44ec-80b0-92c8d1f2e3fa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873855433" status: 202 len: 0 microversion: 2.1 time: 0.024431 Aug 04 21:00:45.818472 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 321/616] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Aug 4 21:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873855433 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:46.475070 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: .version_select at 0x7f2bda001dc0>, body: {"keypair": {"name": "tempest-keypair-691621743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoaUhUvvZ11+ePBCqPD9mNAyAzFoTQTwNE6uZIcDguw1bIGIjYifSS9mj+TnYrJxULctPZa9vwgbSMyYJPytq2KyRmwxvs2sTi3Yn9hE4wn5PP4sIV6cerQ4vzlNSu48A=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:46.490640 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:00:46.494693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:00:46.507195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [d05d9338-1477-414b-a981-77629d5fc323] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:00:46.611851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:46.612402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:46.618764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:46.619277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:46.619717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:46.620471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:46.620926 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:46.621364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:46.762076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:46.770720 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1d0a9cf8-d32e-4d67-8709-dbf86c214fd0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.162976 Aug 04 21:00:46.771290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 322/617] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:46 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:47.515634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [d05d9338-1477-414b-a981-77629d5fc323] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50688. Aug 04 21:00:47.531887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8078dd09-0eac-4650-8f04-d6e5bbf830d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.060644 Aug 04 21:00:47.532519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 296/618] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 21:00:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:47.794145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:47.795184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:47.802216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:47.802719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:47.803164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:47.803871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:47.804330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:47.804784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:47.948719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:47.957571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-70086b13-25c7-44a4-8d9d-8dfa76c2f853 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.168333 Aug 04 21:00:47.958187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 323/619] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:47 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:48.848071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480764878", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fc90a20-030f-4833-b078-8e1884210eeb"}], "security_groups": [{"name": "tempest-securitygroup--1847731581"}], "key_name": "tempest-keypair-691621743", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:48.955844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] validate_networks() for [('2fc90a20-030f-4833-b078-8e1884210eeb', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:00:48.979332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:48.979945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:48.986864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:48.987351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:48.987791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:48.988521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:48.989006 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:48.989416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:49.190395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:49.198433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-83da4d1e-c57b-48eb-b6f3-b971483ab1b2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.223280 Aug 04 21:00:49.199002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 324/620] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:48 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:49.441426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:00:49.441857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:00:49.442332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:00:49.442771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:00:49.443182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:00:49.452926 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:49.453394 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:49.453837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:49.454555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:49.455009 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:49.455432 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:49.472973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:00:49.476863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:00:49.488674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:00:49.490956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:00:49.539683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-697dd571-e347-4669-bb1a-64e9de2545d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.696324 Aug 04 21:00:49.540349 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 297/621] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:00:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:00:49.551740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-014fa37e-037e-4a03-9af3-679a66ae46d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:49.552361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-014fa37e-037e-4a03-9af3-679a66ae46d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:49.605449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-014fa37e-037e-4a03-9af3-679a66ae46d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:49.612178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-014fa37e-037e-4a03-9af3-679a66ae46d9 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1240 microversion: 2.1 time: 0.064514 Aug 04 21:00:49.612774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 325/622] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:49 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:50.220288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:50.220943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:50.227092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.227580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.228038 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.228959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.229503 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.230057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.379800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:50.387584 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-088dffec-d03b-4c9b-afe2-31cd120c9c9e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.172364 Aug 04 21:00:50.388137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 298/623] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:50 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:50.467808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:50.468378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:50.474326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.474801 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.475233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.475915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.476464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.476892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.505579 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-59846b03-261b-4a69-9215-2577fd96f7e7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments/4a0ee9d3-d8a6-4e9a-aee3-f968cc980f80" status: 200 len: 194 microversion: 2.20 time: 0.042363 Aug 04 21:00:50.506157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 326/624] 10.222.0.52 () {60 vars in 1454 bytes} [Thu Aug 4 21:00:50 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments/4a0ee9d3-d8a6-4e9a-aee3-f968cc980f80 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:00:50.576663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:50.577162 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:50.587461 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.587925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.588400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.589134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.589618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.590528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.635126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-55ad0e12-ffda-4c13-9f1a-215d870bca5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:50.636497 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-55ad0e12-ffda-4c13-9f1a-215d870bca5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:50.693837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lazy-loading 'services' on Instance uuid f9ada2ad-514c-4711-b112-c18aeee76d7c {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:00:50.713741 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-55ad0e12-ffda-4c13-9f1a-215d870bca5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:50.722648 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-55ad0e12-ffda-4c13-9f1a-215d870bca5f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1240 microversion: 2.1 time: 0.094776 Aug 04 21:00:50.723419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 327/625] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:50 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:50.784892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cf90386d-4571-4e94-a640-58fffc1542cd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments/4a0ee9d3-d8a6-4e9a-aee3-f968cc980f80" status: 202 len: 0 microversion: 2.20 time: 0.212084 Aug 04 21:00:50.785668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 299/626] 10.222.0.52 () {60 vars in 1457 bytes} [Thu Aug 4 21:00:50 2022] DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments/4a0ee9d3-d8a6-4e9a-aee3-f968cc980f80 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:00:50.795076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:50.797311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:50.804038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.804552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.805022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.805716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:50.806170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:50.806591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:50.810360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:50.836328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f05264b5-0c65-4e7d-a0df-2c2792d870a9 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046378 Aug 04 21:00:50.836908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 328/627] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Aug 4 21:00:50 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:00:51.410067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:51.410772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:51.419387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:51.419990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:51.420458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:51.421155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:51.421608 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:51.422028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:51.561706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:51.569784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2334ee58-8036-43f1-af85-9f23cfba9955 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.164510 Aug 04 21:00:51.570366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 300/628] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:51 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:51.743813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3d6b7d6a-eb96-4189-8519-ca9ac9a787f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:51.744446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3d6b7d6a-eb96-4189-8519-ca9ac9a787f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:51.796378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3d6b7d6a-eb96-4189-8519-ca9ac9a787f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:51.803512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3d6b7d6a-eb96-4189-8519-ca9ac9a787f4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1240 microversion: 2.1 time: 0.063518 Aug 04 21:00:51.804078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 329/629] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:51 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:51.849491 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:51.851740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:51.859105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:51.859600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:51.860046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:51.860773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:51.861234 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:51.861665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:51.896213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d9887f71-e758-46b4-9765-c305dafb8277 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050544 Aug 04 21:00:51.897019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 301/630] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Aug 4 21:00:51 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:00:52.593736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:52.594335 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:52.600200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:52.600714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:52.601153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:52.601826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:52.602273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:52.602691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:52.738942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:52.747409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2d056842-cee6-403e-9874-5450a7502ae3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.158298 Aug 04 21:00:52.747994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 330/631] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:52 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:52.826707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c88bf21-d883-4656-af34-5aabeef033db tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:52.827606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c88bf21-d883-4656-af34-5aabeef033db tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:52.891308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6c88bf21-d883-4656-af34-5aabeef033db tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:52.899750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c88bf21-d883-4656-af34-5aabeef033db tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1240 microversion: 2.1 time: 0.077669 Aug 04 21:00:52.900625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 302/632] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:52 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:52.918846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:52.921380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:52.928825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:52.929375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:52.929817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:52.930624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:52.931121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:52.931629 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:52.972447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9b48a794-ac3a-4a4e-86db-511ba8fc0708 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057430 Aug 04 21:00:52.977762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 331/633] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Aug 4 21:00:52 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:00:53.769387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:53.770000 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:53.776098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.776612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.777141 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.777761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.778220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.779041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.908177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:53.915788 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1639aa09-ee6b-44fa-84f5-441b78fdf3b6 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1507 microversion: 2.1 time: 0.150240 Aug 04 21:00:53.916440 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 303/634] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:53 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:53.926206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:53.927344 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:53.939138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.939978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.940810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.942047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.942888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.943651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.952465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:53.953058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:53.959216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.959698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.960126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.960849 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:53.961296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:53.961717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:53.992005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124350) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:00:54.013969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:54.021161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-89e7b60f-eba3-467a-99f7-6cfda743fb4d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1244 microversion: 2.1 time: 0.103441 Aug 04 21:00:54.022605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 332/635] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:53 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:54.028736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:54.031427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:54.039568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.040301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.040756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.041450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.041898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.042315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.078540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5fca7ee1-c5d4-4dfa-be17-0186204536e2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054778 Aug 04 21:00:54.079556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 333/636] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Aug 4 21:00:54 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:54.094302 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5da889d-7fbe-40e7-8a01-8ad90ba9d41d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "POST /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6/action" status: 202 len: 0 microversion: 2.1 time: 0.146269 Aug 04 21:00:54.095314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 304/637] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 21:00:53 2022] POST /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:00:54.103578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:54.104205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:54.111189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.111854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.112465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.113789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.114329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.114764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.159709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:54.160631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:54.167130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.168269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.170715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.172025 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.172778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.173450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.209520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:00:54.327870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2c72e1e-b749-4837-9672-2d1e24817891 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 204 len: 0 microversion: 2.20 time: 0.171580 Aug 04 21:00:54.329161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 305/638] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Aug 4 21:00:54 2022] DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:00:54.412851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:54.422586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-de70a9cb-ec93-4e63-8207-c6b263347071 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1515 microversion: 2.1 time: 0.323289 Aug 04 21:00:54.423168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "name": "network-vif-unplugged", "status": "completed", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:54.423351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 334/639] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:54 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:54.427911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:54.428537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:54.428870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:54.436598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.437812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.438439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.439176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.439634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.440061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.445661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:54.445661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:54.446474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:54.460890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.compute.server_external_events [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] Unable to find a host for instance 31aff8d0-643a-43ac-b774-b9efab7310e6. Dropping event network-vif-unplugged {{(pid=124350) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 21:00:54.461825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9ef7f00b-cfd0-47bd-9f75-cd57b5a6c101 req-f0e09b28-1440-4e75-90b4-3ec07839b7eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.130922 Aug 04 21:00:54.462526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 306/640] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 132 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 21:00:54.586514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:54.596361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:54.598393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:54.599003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6a4f63f8-a0e6-421f-bf91-4d088b6a7645 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.174930 Aug 04 21:00:54.599568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 335/641] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:00:54 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:00:55.044362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:55.045101 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:55.051642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.052153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.052621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.053311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.053771 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.054195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.115469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:55.123232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49313414-2bd7-45ee-a3ba-06326dd80721 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1236 microversion: 2.1 time: 0.083241 Aug 04 21:00:55.123810 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 307/642] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:55 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:55.445919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:55.446538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:55.453346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.453828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.454266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.454955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.455408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.455860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.599411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:55.610830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-edd8dae1-ade9-411a-83e9-1cb34de98fd2 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1515 microversion: 2.1 time: 0.168462 Aug 04 21:00:55.611614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 336/643] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:55 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:55.623452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:55.624063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:55.630085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.630567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.631004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.631696 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:55.632152 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:55.632607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:55.771445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:55.780296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:55.781839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:55.783008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-88b7a139-0926-4d4f-8f22-07bf8a4efb5f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.165001 Aug 04 21:00:55.783573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 308/644] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:00:55 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:00:56.145024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:56.145670 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:56.152278 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.152739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.153221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:56.153926 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.154385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.154810 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:56.217954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:56.225918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-77868d99-ef5d-469c-be7c-54245a7b473e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1292 microversion: 2.1 time: 0.084770 Aug 04 21:00:56.226552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 337/645] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:56 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:56.640617 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:56.641241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:56.648481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.649275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.650134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:56.651171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.651796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.652405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:56.807447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:56.808137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:56.821838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.822343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.822787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:56.823502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:56.824017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:56.824481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:57.338137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:57.347128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f99a1027-c783-4c7c-b714-f3e624a94d8a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1517 microversion: 2.1 time: 0.710455 Aug 04 21:00:57.347718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 309/646] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:56 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1517 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:57.363963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:57.364883 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:57.372590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:57.373075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:57.373734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:57.374522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:57.375023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:57.375446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:57.445463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:57.454183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:57.455812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:57.457198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-62a277de-b4ee-4f5a-a64b-f27f112b4130 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1725 microversion: 2.20 time: 0.654093 Aug 04 21:00:57.457781 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 338/647] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:00:56 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1725 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:00:57.472528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:57.481525 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9a5b8512-7b45-4085-b006-7d2a52c4b0c8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1298 microversion: 2.1 time: 0.132000 Aug 04 21:00:57.482367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 310/648] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:57 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:57.703723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2060246398"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:57.704556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:57.713287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:57.713945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:57.714600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:57.716528 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:57.717634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:57.718143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:58.045601 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.network.security_group_api [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Removing security group 392ba0de-3ff9-49ea-b006-8d8854251bf5 from port 932aa5cf-9a6b-4336-b1b8-01061f95dddb Aug 04 21:00:58.370224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:58.370224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:58.377095 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:58.377828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:58.378468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:58.379396 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:58.380049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:58.380698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:58.823805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:58.837456 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-148dd5a6-a597-4d0a-99f1-81846a36a14e tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.472142 Aug 04 21:00:58.838282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 311/649] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:58 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:00:58.853916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:58.854741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:58.862873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:58.864018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:58.864537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:58.865292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:58.865812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:58.866425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:58.873056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:59.035417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:59.044607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:59.046532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:59.047891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8321e1c2-1b7f-4ad9-b60e-fba0abb2b138 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1657 microversion: 2.20 time: 0.203624 Aug 04 21:00:59.048806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 312/650] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:00:58 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1657 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:00:59.053769 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:59.054467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:59.061157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:59.062172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:59.062172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:59.062872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:59.063913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:59.063913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:59.066436 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6d81ed5b-4e88-487d-8fd5-2dcb851c9a22 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action" status: 202 len: 0 microversion: 2.1 time: 1.368213 Aug 04 21:00:59.070837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 339/651] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Aug 4 21:00:57 2022] POST /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:00:59.077328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:00:59.098405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:59.099155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:59.099782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:59.131278 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] Creating event network-changed:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 21:00:59.146419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-4ed06ddc-30ec-435a-8fac-85bb60bac9d0 req-90032691-8d96-415a-82ff-e6e5e179baf5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074071 Aug 04 21:00:59.151997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 340/652] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:00:59.435679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:00:59.444250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c777e018-dcb1-46e3-93d1-530c595066b2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.394594 Aug 04 21:00:59.445218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 313/653] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:59 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:00:59.869421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:00:59.870460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:00:59.882672 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:59.883772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:59.885338 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:00:59.886443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:00:59.887069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:00:59.887718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.086035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:00.087775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:00.095666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:00.100649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.101437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.102063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.104576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.105236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.107219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.196491 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.198816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.200805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.202745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lazy-loading 'fault' on Instance uuid f9ada2ad-514c-4711-b112-c18aeee76d7c {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:00.617625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:00.623596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:00.631089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:00.632216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1fd98116-95cd-463e-bf81-770a7c94d4d3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.773112 Aug 04 21:01:00.634171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:00.635738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5e6fc68-a49e-44b6-8a44-4f02c5863b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 200 len: 1372 microversion: 2.20 time: 0.563980 Aug 04 21:01:00.637519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 341/654] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:00:59 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:00.648065 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:00.649006 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:00.655723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 314/655] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:00 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 1372 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:00.659377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.660444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.660974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.662264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.663307 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.663974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.891572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:00.892549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:00.901476 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.904376 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.906667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:00.906667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:00.906667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:00.908406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.008782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lazy-loading 'services' on Instance uuid 6c7b8f93-053c-48ad-9858-b666ee840377 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:01.022286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:01.032809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3b64e28b-5607-4d2f-a7d0-7ac82a5bcc7b tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.392918 Aug 04 21:01:01.040723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 342/656] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:00 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:01.119715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e556fef1-d1e1-4e22-9116-6216579289b5 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments/7a12f3e3-100b-4cf0-a11d-dad292742058" status: 202 len: 0 microversion: 2.1 time: 0.233369 Aug 04 21:01:01.126553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 315/657] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:01:00 2022] DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments/7a12f3e3-100b-4cf0-a11d-dad292742058 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:01:01.138500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:01.144452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:01.147323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:01.159072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.159889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.160572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.161706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.163046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.164018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.165526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.166011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.166443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.183946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] Creating event network-changed:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 21:01:01.194164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-385b8655-acb3-4a52-a311-b585bc434a54 req-cf7771b2-848c-41f3-94ad-625fe146911c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151030 Aug 04 21:01:01.195273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 343/658] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:01.203245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ada2ad-514c-4711-b112-c18aeee76d7c", "name": "network-vif-deleted", "tag": "8499542f-ed09-42e0-9e68-8b3dcb6ce4a8"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:01.216129 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.216895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.217517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.227968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d4e458a-f03d-4f29-b4fb-d8f52fd68b0e tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094742 Aug 04 21:01:01.230190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 316/659] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:01 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:01.238993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] Creating event network-vif-deleted:8499542f-ed09-42e0-9e68-8b3dcb6ce4a8 for instance f9ada2ad-514c-4711-b112-c18aeee76d7c on hv-cinder-83602 Aug 04 21:01:01.244774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-0aa5009c-dab9-4880-8b77-b73cf1204f3a req-1b0843f0-78c1-48ba-9da8-0cd010e12f57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047735 Aug 04 21:01:01.246392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 344/660] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:01.659507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:01.660133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:01.662029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:01.662910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:01.669483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.669483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.670405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.670642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.670974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.671398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.671642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.672090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:01.672288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.672725 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:01.673031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.673172 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:01.687673 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c HTTP/1.1 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:01.690899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:01:01.692645 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'f9ada2ad-514c-4711-b112-c18aeee76d7c'} Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:01.694474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:01:01.695997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:01.697404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:01.697404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f3bdcf2c-bd08-49d9-8742-65f68e37f8c0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 404 len: 111 microversion: 2.20 time: 0.034558 Aug 04 21:01:01.697404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 345/661] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:01 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 21:01:01.702569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6398ee3d-a96a-4754-908c-ebdc12cffd12 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '.version_select at 0x7f2bda90eca0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:01.725104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6398ee3d-a96a-4754-908c-ebdc12cffd12 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902644149" status: 204 len: 0 microversion: 2.20 time: 0.027478 Aug 04 21:01:01.729522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 346/662] 10.222.0.52 () {60 vars in 1262 bytes} [Thu Aug 4 21:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902644149 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 21:01:01.912878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:01.921470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-23cfcded-1bf6-4999-bd5e-2f2043d2a6fa tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.266052 Aug 04 21:01:01.922080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 317/663] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:01 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:02.055197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:02.055726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:02.057827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:02.065991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.066483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.066919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.067620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.068068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.068695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.245309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:02.248056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:02.254893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.255395 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.255853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.256572 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.257206 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.257789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.296004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5a5c1a5c-afee-4139-a940-1b8562d21acf tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056798 Aug 04 21:01:02.296892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 318/664] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:02 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:01:02.307623 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:02.308155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:02.316852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.317713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.318759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.320290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.321196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.322565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.407435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] HTTP exception thrown: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 is not attached to volume 7a12f3e3-100b-4cf0-a11d-dad292742058 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Request method failure captured: Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments/7a12f3e3-100b-4cf0-a11d-dad292742058 HTTP/1.1 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DJ2Cgya9rsMKYJV_Z-vijTG0OhpQz3c-hZejvdIY4Dh0uxwcVtOeMoJIBd4eOMTv18R-ORv8FVB4jsadK5Ey9vsCgloJE8VVOG9vfH1_caws1S2t9CcfXC6Z0TLiAImEhmNZVp2uw6T7P1elTEuxCvG55yUIOWHQ9rKH-9I5_48fIQ Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 06b449da3f4248579c6a12f07c7f5b55 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:02.409936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/06b449da3f4248579c6a12f07c7f5b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/06b449da3f4248579c6a12f07c7f5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_06b449da3f4248579c6a12f07c7f5b55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/06b449da3f4248579c6a12f07c7f5b55"}]}] Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 06b449da3f4248579c6a12f07c7f5b55 Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-TestMinimumBasicScenario-1757694505-project Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: c10b35e8364c4789b7a926888f1e7234 Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestMinimumBasicScenario-1757694505-project Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:01:02.411424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 is not attached to volume 7a12f3e3-100b-4cf0-a11d-dad292742058 Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '6c7b8f93-053c-48ad-9858-b666ee840377', 'id': '7a12f3e3-100b-4cf0-a11d-dad292742058'} Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7a12f3e3-100b-4cf0-a11d-dad292742058. Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:02.412473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 is not attached to volume 7a12f3e3-100b-4cf0-a11d-dad292742058 Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 is not attached to volume 7a12f3e3-100b-4cf0-a11d-dad292742058 Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:02.413841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Returning 404 to user: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 is not attached to volume 7a12f3e3-100b-4cf0-a11d-dad292742058 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:02.414894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c6c32983-24fb-43e1-a8b6-f8e4b91d2921 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments/7a12f3e3-100b-4cf0-a11d-dad292742058" status: 404 len: 154 microversion: 2.1 time: 0.107746 Aug 04 21:01:02.414894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 319/665] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:01:02 2022] DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377/os-volume_attachments/7a12f3e3-100b-4cf0-a11d-dad292742058 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:01:02.575876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:02.583490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-edeba648-5a39-4b04-82c3-dc92fcad587d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.532771 Aug 04 21:01:02.584070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 347/666] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:02 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:02.945018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:02.945831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:02.949166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=12 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:02.955452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.956023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.956904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:02.957561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:02.958067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:02.958455 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.246041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:03.254466 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dcadfba4-3b51-4286-a6d2-a01105d9b37b tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.313726 Aug 04 21:01:03.255138 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 320/667] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:02 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:03.262634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28bf7558-e193-499d-a67f-701ea32da4f0", "tag": "d1f6d272-47a4-47d4-b13e-93cb2976eca5"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:03.272020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.272637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.272933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.285559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] Creating event network-changed:d1f6d272-47a4-47d4-b13e-93cb2976eca5 for instance 28bf7558-e193-499d-a67f-701ea32da4f0 on hv-cinder-83602 Aug 04 21:01:03.291031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-65375995-153a-4255-872d-f158f39e58e1 req-7cd62f90-6aab-4382-92e3-56f39c46ec66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031931 Aug 04 21:01:03.291932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 348/668] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:03.319606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57bfbac5-b44b-4d35-a931-d69f489c568d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: .version_select at 0x7f2bda001ca0>, body: {"keypair": {"name": "tempest-keypair-1182737540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx8TgG7LFBTCLWU5WwP9EMWWsh+O6hA0rifuQgeaXwyTYjDSFvGhJ2zDfhcjfw0ZywY60TAJkurP/wknSYhJ/WsBnP++lyCNJs8572rQt1sBSHmIH+vetd2RTwBrDXL0g=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:03.335286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57bfbac5-b44b-4d35-a931-d69f489c568d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:01:03.339327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57bfbac5-b44b-4d35-a931-d69f489c568d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for user a1930e444b5b47ea8e606c7ee4da600f and project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:01:03.365099 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57bfbac5-b44b-4d35-a931-d69f489c568d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049217 Aug 04 21:01:03.366089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 321/669] 10.222.0.52 () {62 vars in 1200 bytes} [Thu Aug 4 21:01:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 21:01:03.591952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:03.592684 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:03.594839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:03.603705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.604615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.605086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.606433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.606916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.607353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.608218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:03.609297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:03.620737 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.621435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.622119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.623128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.624508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.625246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.638742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:01:03.669633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:03.740034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-539a9a4c-6283-4f15-bcdd-a4b6c53aba64 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 204 len: 0 microversion: 2.1 time: 0.154042 Aug 04 21:01:03.741367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 349/670] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:01:03 2022] DELETE /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:01:03.752173 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:03.752905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:03.760311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.760843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.761286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.762037 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:03.762698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:03.763288 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:03.789419 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:03.798695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-385666cc-3919-4ad2-8011-99ecc401cd59 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.195554 Aug 04 21:01:03.799281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 322/671] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:03 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:03.926703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:03.934777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-29379c05-7e4b-42dc-8d61-5f1ad34b79e8 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1671 microversion: 2.1 time: 0.186698 Aug 04 21:01:03.935453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 350/672] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:03 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:04.275986 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:04.276644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:04.284243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:04.284776 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:04.285222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:04.285924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:04.286573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:04.287001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:04.442648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:04.452259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-afa90808-65a2-42b7-ae4f-d23c815f8607 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.179714 Aug 04 21:01:04.453117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 323/673] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:04 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:04.710807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1621520904", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f888fc91-7d8c-4649-9bc4-c28566886ae4"}], "security_groups": [{"name": "tempest-securitygroup--2141751231"}], "key_name": "tempest-keypair-1182737540", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:04.813562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] validate_networks() for [('f888fc91-7d8c-4649-9bc4-c28566886ae4', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:01:04.822940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:04.823552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:04.830270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:04.830766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:04.831202 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:04.831894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:04.832371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:04.832799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.018110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:05.027614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0cd393d5-dcbe-4562-a160-e39e509715b4 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.208763 Aug 04 21:01:05.028202 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 324/674] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:04 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:05.033422 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:05.034172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:05.040606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.041090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.041529 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.042227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.042681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.043107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.244763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:05.253278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-538f2433-0490-4138-ac01-5d77b532781d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1671 microversion: 2.1 time: 0.224006 Aug 04 21:01:05.253862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 325/675] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:05 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:05.473994 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:05.474694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:05.481039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.481574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.481987 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.482781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.483283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.483748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.660389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:01:05.660814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:01:05.661281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:01:05.661681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:01:05.662088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:01:05.671614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.672103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.672586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.673316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:05.673771 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:05.674221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:05.693392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:05.693746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:01:05.698354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Getting quotas for user a1930e444b5b47ea8e606c7ee4da600f and project c791c03c7d7b40fcb2e0ffad05d78172. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:01:05.702034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1405e513-8dcc-4793-b4ab-38b63e7a7af7 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.232128 Aug 04 21:01:05.702610 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 326/676] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:05 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:05.710611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:01:05.712811 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:01:05.755817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [f1adb8b9-f2cd-4c7e-80ae-3c327648828b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:01:06.048965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:06.049570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:06.056187 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.056699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.057140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.057811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.058260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.058679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.209338 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.218153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8dc90821-6528-4f2c-b5b3-9d815e608aaa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.172798 Aug 04 21:01:06.218753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 327/677] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:06 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:06.274350 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:06.274964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:06.281464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.281974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.282400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.283105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.283565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.283994 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.419132 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.422581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:06.427734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae86887a-37a5-41ad-a5a4-1891583ec88f tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1553 microversion: 2.1 time: 0.157202 Aug 04 21:01:06.428301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 328/678] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:06 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:06.723205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:06.723844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:06.730607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.731295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.731519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.732205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:06.732716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:06.733154 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:06.763654 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [f1adb8b9-f2cd-4c7e-80ae-3c327648828b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50936. Aug 04 21:01:06.768112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a8a00162-9108-4458-b4fd-77c282a919d4 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.061525 Aug 04 21:01:06.769000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 351/679] 10.222.0.52 () {62 vars in 1188 bytes} [Thu Aug 4 21:01:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 21:01:06.781488 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:06.782191 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:06.868552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.880799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.882994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.887748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fedfc1d6-1995-47c2-93a9-2c5861e25fbf tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1282 microversion: 2.20 time: 0.111006 Aug 04 21:01:06.888625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 352/680] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:06 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:01:06.928908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:06.939519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cfae73d1-d403-43cd-89ef-3377217906ac tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.220202 Aug 04 21:01:06.940496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 329/681] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:06 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:07.240477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:07.241111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:07.248375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.248862 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.249302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.250009 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.250502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.250922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.387081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:07.394626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2d6c2907-1f1f-45b6-9757-8f1d4fc4c182 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.158019 Aug 04 21:01:07.395209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 353/682] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:07 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:07.448312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:07.448942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:07.455540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.456014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.456477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.457167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.457619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.458033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.590339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:07.598096 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8cb9e861-1177-412b-ae98-e7df049a3111 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1553 microversion: 2.1 time: 0.153712 Aug 04 21:01:07.598741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 330/683] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:07 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:07.910035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:07.910717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:07.916610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.917090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.917523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.918829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.919407 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.919829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.961885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:07.962578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:07.969252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.969744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.970181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.970878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:07.971340 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:07.971764 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:07.983216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:07.991312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:07.992919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:07.994145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8c8cfff5-ccbe-4d9c-a861-2ffad9e20c33 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1286 microversion: 2.20 time: 0.088086 Aug 04 21:01:07.994708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 354/684] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:07 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:08.108230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:08.115743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d81d12b3-3e0e-41b7-88da-d9f09111114c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.157651 Aug 04 21:01:08.116331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 331/685] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:07 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:08.288007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf7558-e193-499d-a67f-701ea32da4f0", "name": "network-vif-plugged", "status": "completed", "tag": "d1f6d272-47a4-47d4-b13e-93cb2976eca5"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:08.300180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:08.301032 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:08.301471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:08.312767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] Creating event network-vif-plugged:d1f6d272-47a4-47d4-b13e-93cb2976eca5 for instance 28bf7558-e193-499d-a67f-701ea32da4f0 on hv-cinder-83602 Aug 04 21:01:08.317860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-06b61541-0f71-44c0-88c7-c099a403b1c6 req-7afe1e21-fd41-4cc0-8cb7-701b2b9eb74a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033547 Aug 04 21:01:08.318458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 355/686] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:08.415289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:08.415895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:08.422669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:08.423090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:08.423527 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:08.424253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:08.424736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:08.425172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:08.619257 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:08.624877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:08.625844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:08.628896 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4b44fad9-2562-4c73-a8ce-c1d3a720278d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.217316 Aug 04 21:01:08.630016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 332/687] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:08 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:08.633756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:08.634323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:08.634962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:08.635682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:08.636137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:08.636820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:08.845435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:08.853345 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-94a0ed3f-db1c-444f-8d6f-3bb8f74b1858 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1553 microversion: 2.1 time: 0.236383 Aug 04 21:01:08.853941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 356/688] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:08 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:09.018263 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:09.019008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:09.025620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.026114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.026580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.028215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.028718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.029150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.106244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:09.114560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:09.116073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:09.117241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-56f4f880-0323-4115-ac2f-68f45e502804 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1334 microversion: 2.20 time: 0.103619 Aug 04 21:01:09.117808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 333/689] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:09 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:09.136238 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:09.137406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:09.144163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.144754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.145294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.146103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.146565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.147014 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.363750 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:09.373226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3719b7a1-4e86-4996-a7b3-bb3bb50c243d tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.240687 Aug 04 21:01:09.373817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 357/690] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:09 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:09.477075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7b8f93-053c-48ad-9858-b666ee840377", "name": "network-vif-deleted", "tag": "932aa5cf-9a6b-4336-b1b8-01061f95dddb"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:09.487885 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.488396 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.488834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.501506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] Creating event network-vif-deleted:932aa5cf-9a6b-4336-b1b8-01061f95dddb for instance 6c7b8f93-053c-48ad-9858-b666ee840377 on hv-cinder-83602 Aug 04 21:01:09.506907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-50d00a49-ff4e-477c-a0de-7b50aff6453e req-dc628bd9-dc5c-4ab9-9882-e93909bee6cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Aug 04 21:01:09.507766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 334/691] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:09.650730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:09.651411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:09.658412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.658959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.659430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.660248 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.660893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.661353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.815325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:09.823703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d79a74d0-3f88-427a-9582-a1b5c528c6e5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.176760 Aug 04 21:01:09.824444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 358/692] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:09 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:09.938819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:09.939525 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:09.946273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.946814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.947258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:09.947983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:09.948504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:09.948931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.014304 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:10.021813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-275ba702-dfb4-4586-883c-5d805f63c37d tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1343 microversion: 2.1 time: 0.087479 Aug 04 21:01:10.022388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 335/693] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:09 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:10.140634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:10.141401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:10.147712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.148222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.148667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.149373 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.149817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.150239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.219102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:10.228416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:10.229923 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:10.231271 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-89cbd10c-fa87-4b00-8ca7-3f82ec4a49c3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1342 microversion: 2.20 time: 0.095296 Aug 04 21:01:10.231846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 359/694] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:10 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:10.394978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:10.395809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:10.402679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.403582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.404193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.405105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.405727 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.406353 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.681881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:10.690759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86942c54-5779-4da8-8107-f2b7e3de164a tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.299281 Aug 04 21:01:10.691338 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 336/695] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:10 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:10.847660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:10.848243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:10.854175 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.854712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.855186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.856593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.856946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.857362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.941151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:10.941768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:10.948760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.948760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.949279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:10.957825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:10.958444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:10.959004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.008573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.016966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7935ca30-6a34-45da-b61c-31bcd3b3c690 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1366 microversion: 2.1 time: 0.173087 Aug 04 21:01:11.030882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 360/696] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:10 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:11.044830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:11.045669 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:11.052540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.053195 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.053802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.054681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.055294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.055713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.059388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lazy-loading 'services' on Instance uuid b064df63-ae6f-4ea7-8c62-8750bedfde15 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:11.087879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.088380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.088822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.089322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lazy-loading 'fault' on Instance uuid 6c7b8f93-053c-48ad-9858-b666ee840377 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:11.157094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-98af4052-aa56-4efb-a215-9410956a7140 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments/b8c3738e-47ea-47b9-9159-3038a8f4ba49" status: 202 len: 0 microversion: 2.1 time: 0.219049 Aug 04 21:01:11.158256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 337/697] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:01:10 2022] DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments/b8c3738e-47ea-47b9-9159-3038a8f4ba49 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:01:11.174262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:11.177645 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:11.186642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.187662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.188294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.189826 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.190302 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.191006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.194204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b35e8364c4789b7a926888f1e7234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b449da3f4248579c6a12f07c7f5b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.204455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ad2ba6c3-54b2-4134-8f3a-9bd399f0bbd0 tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 200 len: 1348 microversion: 2.1 time: 0.164894 Aug 04 21:01:11.206568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 361/698] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:11 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 1348 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:11.225877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-18ddf988-255c-4a26-aa24-019ff42f446e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062299 Aug 04 21:01:11.226710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 338/699] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:11 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:11.254971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:11.255583 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:11.262185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.263136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.263579 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.264284 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.265033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.265461 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.348635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.357274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.358786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.359887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7bef3a19-23ca-4dfe-8887-5242bcd1e842 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1340 microversion: 2.20 time: 0.109106 Aug 04 21:01:11.360463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 362/700] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:11 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:11.711135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:11.711778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:11.719063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.719549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.719989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.720727 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:11.721194 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:11.721618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:11.862878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:11.870811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-61b9c5fe-036e-467d-8c4b-9d15ce5b0e67 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.163615 Aug 04 21:01:11.871876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 339/701] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:11 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:12.038744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.039362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.049358 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.049852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.050573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.051492 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.051776 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.052201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.227266 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.227855 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] [instance: 6c7b8f93-053c-48ad-9858-b666ee840377] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.236879 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.237546 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.238171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.239283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.240103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.240649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.255370 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] HTTP exception thrown: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Request method failure captured: Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 HTTP/1.1 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DJ2Cgya9rsMKYJV_Z-vijTG0OhpQz3c-hZejvdIY4Dh0uxwcVtOeMoJIBd4eOMTv18R-ORv8FVB4jsadK5Ey9vsCgloJE8VVOG9vfH1_caws1S2t9CcfXC6Z0TLiAImEhmNZVp2uw6T7P1elTEuxCvG55yUIOWHQ9rKH-9I5_48fIQ Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 06b449da3f4248579c6a12f07c7f5b55 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:12.257074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/06b449da3f4248579c6a12f07c7f5b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/06b449da3f4248579c6a12f07c7f5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_06b449da3f4248579c6a12f07c7f5b55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/06b449da3f4248579c6a12f07c7f5b55"}]}] Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 06b449da3f4248579c6a12f07c7f5b55 Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1757694505 Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-TestMinimumBasicScenario-1757694505-project Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: c10b35e8364c4789b7a926888f1e7234 Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestMinimumBasicScenario-1757694505-project Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. Aug 04 21:01:12.258718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '6c7b8f93-053c-48ad-9858-b666ee840377'} Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:12.259591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. Aug 04 21:01:12.261512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:12.263714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Returning 404 to user: Instance 6c7b8f93-053c-48ad-9858-b666ee840377 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:12.263714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c0573c00-41c6-4738-b6f4-c5535272c03b tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377" status: 404 len: 111 microversion: 2.1 time: 0.035156 Aug 04 21:01:12.263714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 340/702] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/6c7b8f93-053c-48ad-9858-b666ee840377 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:01:12.265874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.267366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:12.268063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.274803 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.275301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.275795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.275913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b199c4a3-339a-405f-9ed8-a0c3603a55a0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1557 microversion: 2.1 time: 0.240966 Aug 04 21:01:12.276388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 363/703] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:12.276625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.276996 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.277557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.281843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7708981c-f8d0-4555-a162-90da728e2dcc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] Calling method '.version_select at 0x7f2bda801310>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.303191 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7708981c-f8d0-4555-a162-90da728e2dcc tempest-TestMinimumBasicScenario-1757694505 tempest-TestMinimumBasicScenario-1757694505-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-758836172" status: 202 len: 0 microversion: 2.1 time: 0.025210 Aug 04 21:01:12.307730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 364/704] 10.222.0.52 () {58 vars in 1269 bytes} [Thu Aug 4 21:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-758836172 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:01:12.311175 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1fd89308-0744-4aae-9e6a-591f188a41cc tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050650 Aug 04 21:01:12.311293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.316269 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.316460 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 341/705] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:12.322603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.323079 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.323532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.324382 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.324849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.325966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.383258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.383877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.390837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.391339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.391780 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.392532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.393081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.393419 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.441117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-40790e5a-febf-489e-9327-7567495430f0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135484 Aug 04 21:01:12.444780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 365/706] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:12.534357 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:12.545059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:12.547165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:12.548805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1285d973-36cc-4588-a8eb-95c8d8596c44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1340 microversion: 2.20 time: 0.169206 Aug 04 21:01:12.549356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 342/707] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:12.693300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "name": "network-vif-plugged", "status": "completed", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:12.716256 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.716848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.717336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.738978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] Creating event network-vif-plugged:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 21:01:12.746091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-ad32e7e3-2fdc-4706-a63e-2f2af4752b68 req-33040fbc-73ee-4eed-a05e-3138523fd7f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061285 Aug 04 21:01:12.747740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 366/708] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:12.892035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:12.893020 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:12.907179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.908003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.911172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:12.913042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:12.914293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:12.919631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.313789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:13.322933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49fb33fe-72ef-4de7-8d2e-8e3038afc50c tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.435054 Aug 04 21:01:13.324143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:13.328220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:13.334005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 343/709] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:12 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:13.337935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.338763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.339208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.340091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.340767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.341700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.376797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1bed45ad-81f9-47cb-b275-e559c5bacc67 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057163 Aug 04 21:01:13.377531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 367/710] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:13 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:01:13.469249 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:13.469966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:13.472261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:13.478689 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.479351 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.479921 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.481689 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.482135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.482660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.522637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:01:13.577518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:13.578589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:13.586290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.587197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.587699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.588660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.590094 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.590908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.596384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:13.641925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65672b67-2dc5-4364-912a-b56fe1eefc7e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 204 len: 0 microversion: 2.1 time: 0.177269 Aug 04 21:01:13.643119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 344/711] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:01:13 2022] DELETE /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:01:13.651545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:13.653259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:13.662958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.663549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.664309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.664897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:13.665386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:13.665820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:13.943038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:13.953148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:13.954661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:13.956019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-396f1225-68b6-421f-a47f-31ad19cfb019 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.385071 Aug 04 21:01:13.956866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 368/712] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:13 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:01:13.981859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:13.995744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-030a5be5-876d-47d5-8c4b-7e8cff0fc3ef tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1690 microversion: 2.1 time: 0.347827 Aug 04 21:01:13.997996 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 345/713] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:13 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:14.185686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:14.196326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.196948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:14.197580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:14.211329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] Creating event network-changed:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:01:14.217426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-dca939e4-ff75-413f-840e-6ad7f75d437c req-06562a01-5732-4692-8363-3b382bc9a633 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036225 Aug 04 21:01:14.218383 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 369/714] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:14.354983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:14.357263 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:14.372690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.373843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:14.374489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:14.375513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.376108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:14.376701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:14.542127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:14.558257 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-14fdadf2-98de-4314-9315-9739d0aa0980 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.214938 Aug 04 21:01:14.559174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 346/715] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:14 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:14.584134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28bf7558-e193-499d-a67f-701ea32da4f0", "tag": "d1f6d272-47a4-47d4-b13e-93cb2976eca5"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:14.595517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.595984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:14.596468 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:14.601098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:14.610287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] Creating event network-changed:d1f6d272-47a4-47d4-b13e-93cb2976eca5 for instance 28bf7558-e193-499d-a67f-701ea32da4f0 on hv-cinder-83602 Aug 04 21:01:14.616050 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-227b5168-6a93-41ae-a7de-b91f39ddbaa0 req-d130803f-5430-48f8-9769-11e9fc25513d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035771 Aug 04 21:01:14.616726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 370/716] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:14.979366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:14.980818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:14.986093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:14.994197 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.994812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:14.995121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:14.995829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:14.997315 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:15.000681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:15.020613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:15.021320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:15.043290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:15.044210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:15.044973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:15.045865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:15.046593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:15.047206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:15.227170 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:15.243620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:15.247414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:15.249106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:15.256974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-36b4a9ab-cd1d-400c-b917-f2bd243e125e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.281713 Aug 04 21:01:15.257762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 347/717] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:14 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:15.264497 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2303fa54-d3a7-48fe-9e42-417f5dc6c058 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1690 microversion: 2.1 time: 0.247935 Aug 04 21:01:15.265691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 371/718] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:15 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:15.587143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:15.588697 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:15.597950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:15.599518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:15.600203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:15.601924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:15.602584 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:15.603796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:15.950683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:15.958714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-15c93447-436f-4085-94d7-242cb85ad0f8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.379425 Aug 04 21:01:15.959435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 348/719] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:15 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:16.279990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:16.280745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:16.282573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:16.289194 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:16.289530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.289803 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:16.289920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.290302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:16.291183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.291796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.292406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:16.297608 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.297863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.298404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:16.299417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.300131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.301093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:16.664718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:16.671659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:16.679147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:16.682641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:16.685005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e3c4a6dd-5a4f-4204-a86f-60b340485007 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.409466 Aug 04 21:01:16.686189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 372/720] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:16 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:16.687000 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2d8b08ce-b6d4-455c-b3ef-11e510bd5457 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1690 microversion: 2.1 time: 0.403428 Aug 04 21:01:16.690761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 349/721] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:16 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1690 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:16.978898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:16.979762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:16.982977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=8 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:16.990330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.991166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.991595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:16.992282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:16.992774 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:16.993198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:17.158800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:17.167253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b993ec48-8c9b-4021-ab37-1c41d0ef51e9 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1573 microversion: 2.1 time: 0.191874 Aug 04 21:01:17.169530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 373/722] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:16 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:17.708472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:17.714012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:17.715214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:17.715534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:17.722336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:17.723055 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:17.723489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:17.724559 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:17.725022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:17.725136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:17.725578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:17.725708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:17.726200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:17.727060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:17.727520 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:17.727949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:18.101097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:18.111347 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b5556b5c-a9fe-4a68-92f9-a92984d244e8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1690 microversion: 2.1 time: 0.401145 Aug 04 21:01:18.119912 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:18.125486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 374/723] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:17 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1690 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:18.143528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:18.145653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:18.148209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e8f4e551-c11b-4f19-a26b-763c2e073340 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.443591 Aug 04 21:01:18.161899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 350/724] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:17 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:18.191300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:18.192481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:18.203873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:18.205998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:18.206556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:18.207387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:18.210011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:18.210559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:18.569675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:18.579161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-44978813-e25b-4aed-bf51-b239cc74c46f tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1560 microversion: 2.1 time: 0.391707 Aug 04 21:01:18.579755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 375/725] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:18 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1560 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:19.133595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:19.134721 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:19.142276 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:19.142773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:19.143213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:19.143918 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:19.144402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:19.145140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:19.172786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:19.173802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:19.188225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:19.188730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:19.189378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:19.191630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:19.191630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:19.191630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:19.673590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:19.685094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bfe338a0-ab1a-4e3b-ac6a-dee714e246f7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 200 len: 1690 microversion: 2.1 time: 0.554976 Aug 04 21:01:19.687233 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 351/726] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:19 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 1690 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:19.694609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:19.717854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:19.719897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:19.721685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c9c3b94d-5715-45c4-a500-2d342bc4a43d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.552681 Aug 04 21:01:19.725216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 376/727] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:19 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:19.962878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b064df63-ae6f-4ea7-8c62-8750bedfde15", "name": "network-vif-deleted", "tag": "337e8369-8a47-4c08-920c-b2d58a1dcafa"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:19.973737 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:19.974457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:19.975153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:19.989709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] Creating event network-vif-deleted:337e8369-8a47-4c08-920c-b2d58a1dcafa for instance b064df63-ae6f-4ea7-8c62-8750bedfde15 on hv-cinder-83602 Aug 04 21:01:19.997045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-971c6fd9-6b1f-473d-b897-241e1a8d6662 req-76acfc31-54f7-4e5a-abb1-48bac31eb506 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037167 Aug 04 21:01:20.001524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 352/728] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:20.710254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:20.710970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: b064df63-ae6f-4ea7-8c62-8750bedfde15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:20.717599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:20.718317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:20.718751 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:20.719435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:20.720087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:20.720551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:20.734922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] HTTP exception thrown: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Request method failure captured: Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 HTTP/1.1 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIQNppqY5vBQmsM6c9o9J2g_L-miWgWjHtRPAL8pPfldZGlx-4byeGzbkV0np4zmqu6mbeZmw6uHp4EAxOtKZ0M7SNMI2CLd3OCkUfEo1Rm1w2147YPcI3vtQaT2l2lvssKcblCafFWxPsgIxp4h9jDuNkHa1R-dNUyzR13XzNSCU0 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:20.736621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71b3821ed2f44e848959ac9d2683dab6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71b3821ed2f44e848959ac9d2683dab6"}]}] Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 5026c90f0e3d49669c335ef542280409 Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. Aug 04 21:01:20.737915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'b064df63-ae6f-4ea7-8c62-8750bedfde15'} Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:20.744462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. Aug 04 21:01:20.746183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:20.747268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Returning 404 to user: Instance b064df63-ae6f-4ea7-8c62-8750bedfde15 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:20.747268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-943980c8-de61-4002-a9e1-9ea4a4b85e69 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15" status: 404 len: 111 microversion: 2.1 time: 0.031897 Aug 04 21:01:20.747268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 377/729] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:20 2022] GET /compute/v2.1/servers/b064df63-ae6f-4ea7-8c62-8750bedfde15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:20.747955 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4c1b3c02-7686-4182-b4fd-906119415db1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '.version_select at 0x7f2bd9e0bb80>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:20.760207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:20.763979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:20.778443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:20.779551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:20.780030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:20.780858 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:20.781522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:20.784601 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:20.787219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4c1b3c02-7686-4182-b4fd-906119415db1 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352591874" status: 202 len: 0 microversion: 2.1 time: 0.042764 Aug 04 21:01:20.789028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 353/730] 10.222.0.52 () {58 vars in 1221 bytes} [Thu Aug 4 21:01:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352591874 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:01:21.348621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:21.362160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:21.364112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:21.366964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cad54b75-7a7f-4dc0-9aae-22c77381160b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.612366 Aug 04 21:01:21.379658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 378/731] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:20 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:22.390214 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:22.391748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:22.401924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:22.402420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:22.403018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:22.403741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:22.404225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:22.404862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:22.586400 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:22.595952 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:22.597612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:22.598744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eceea52f-ddfd-4536-ba28-bbee0efe4fd2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.213531 Aug 04 21:01:22.599301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 354/732] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:22 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:23.622654 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:23.623400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:23.629735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:23.630294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:23.630917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:23.631624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:23.632090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:23.632551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:23.768048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:23.776022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:23.777661 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:23.778722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e68e20a0-22e0-4d63-9dde-6a25e28abaff tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.160686 Aug 04 21:01:23.779293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 379/733] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:23 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:23.878654 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:23.879183 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:23.885760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:23.886980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:23.887436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:23.888172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:23.888675 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:23.889079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:23.913782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:01:24.024855 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b740510e-ddc6-4daa-971c-41d5f479d2b8 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 204 len: 0 microversion: 2.1 time: 0.149341 Aug 04 21:01:24.025253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 355/734] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:01:23 2022] DELETE /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:01:24.034210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:24.035134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:24.042938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:24.043448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:24.043892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:24.044635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:24.045269 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:24.045707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:24.481100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:24.490430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-68766be8-8794-4f40-a335-38d090ad4757 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1508 microversion: 2.1 time: 0.460087 Aug 04 21:01:24.491152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 380/735] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:24 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:24.807969 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:24.808645 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:24.818203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:24.819121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:24.819573 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:24.820814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:24.821622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:24.822072 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:25.181890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:25.193212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:25.195600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:25.197200 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-af6d91bc-1553-441a-a742-f7bda3231ec5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.397269 Aug 04 21:01:25.198404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 356/736] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:24 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:25.512197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:25.528449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:25.534829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:25.535611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:25.536274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:25.537221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:25.537886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:25.538533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:25.657206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:25.666547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1f2d12e0-3e85-4b17-9834-92c8e8e61f68 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 200 len: 1466 microversion: 2.1 time: 0.159217 Aug 04 21:01:25.682703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 381/737] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:25 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:25.696752 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8cf39d-924e-44b9-a724-e9cb2d7a87be", "name": "network-vif-deleted", "tag": "5eb68dbc-50ad-4339-b1ca-307285f5949b"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:25.709158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:25.709847 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:25.710466 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:25.734854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] Creating event network-vif-deleted:5eb68dbc-50ad-4339-b1ca-307285f5949b for instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be on hv-cinder-83602 Aug 04 21:01:25.742945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-4ed74608-ba73-4064-9477-178e44c54222 req-b8928db5-f288-48e4-8e58-04b4ced4a975 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049960 Aug 04 21:01:25.747850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 357/738] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:26.223615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:26.224546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:26.232598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.233100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.233730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.234473 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.234889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.235318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.423024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:26.434574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:26.437339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:26.439636 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cca70f70-3a18-470f-96ca-c5491e0a4393 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.220450 Aug 04 21:01:26.440938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 382/739] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:26 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:26.692005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:26.693614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: ca8cf39d-924e-44b9-a724-e9cb2d7a87be] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:26.701653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.702320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.702860 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.703942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.704590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.705123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.720265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] HTTP exception thrown: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Request method failure captured: Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be HTTP/1.1 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIQNppqY5vBQmsM6c9o9J2g_L-miWgWjHtRPAL8pPfldZGlx-4byeGzbkV0np4zmqu6mbeZmw6uHp4EAxOtKZ0M7SNMI2CLd3OCkUfEo1Rm1w2147YPcI3vtQaT2l2lvssKcblCafFWxPsgIxp4h9jDuNkHa1R-dNUyzR13XzNSCU0 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:26.722478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71b3821ed2f44e848959ac9d2683dab6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71b3821ed2f44e848959ac9d2683dab6"}]}] Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 5026c90f0e3d49669c335ef542280409 Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. Aug 04 21:01:26.724182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'ca8cf39d-924e-44b9-a724-e9cb2d7a87be'} Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:26.725164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. Aug 04 21:01:26.726643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:26.728050 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Returning 404 to user: Instance ca8cf39d-924e-44b9-a724-e9cb2d7a87be could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:26.728754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e76e0c5-f470-468f-8523-e1f62112cad7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be" status: 404 len: 111 microversion: 2.1 time: 0.041372 Aug 04 21:01:26.729794 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 358/740] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:26 2022] GET /compute/v2.1/servers/ca8cf39d-924e-44b9-a724-e9cb2d7a87be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:26.738534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:26.739609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:26.746572 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.747180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.748072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.748808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.749270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.749694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.775636 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:01:26.838174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "name": "network-vif-plugged", "status": "completed", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:26.852733 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.853564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.854079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.864219 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:26.871766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] Creating event network-vif-plugged:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:01:26.876522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a16daa0a-1433-4018-9579-c08679f6ea7c tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 204 len: 0 microversion: 2.1 time: 0.141624 Aug 04 21:01:26.878098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 383/741] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:01:26 2022] DELETE /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:01:26.882469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-daf7591a-42a0-4bb5-aa6a-92a0e7f3a98e req-700693b8-97e0-4a0e-b261-579cb64ea159 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050280 Aug 04 21:01:26.883241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 359/742] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:26.890086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:26.890861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:26.901367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.902039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.903132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:26.903970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:26.904592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:26.905330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:27.076422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:27.085760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-efc1e08e-042c-4b09-990e-b63b2d2ab380 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.202035 Aug 04 21:01:27.087135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 384/743] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:26 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:27.467047 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:27.467743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:27.479197 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:27.479691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:27.480786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:27.481664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:27.487943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:27.488536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:27.751523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:27.763326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:27.765248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:27.766628 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-884f96d8-f044-47fb-9509-266eb8445ba2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.305310 Aug 04 21:01:27.767732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 360/744] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:27 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:28.109913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:28.110792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:28.118673 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.119402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.119901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.120989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.121910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.122420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.373703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:28.384920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0d87cccc-cfdf-4afe-a1c1-d89ffd38ed0e tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.279579 Aug 04 21:01:28.386713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 385/745] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:28 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:28.791045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:28.793123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:28.809756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.810258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.810694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.812228 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.812805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.813705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.953760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:28.956328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:28.963215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.963978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.965322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.966714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:28.967523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:28.968112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:28.997519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:29.016112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b9c74080-d887-43b4-9e4e-a3240d512f6a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067308 Aug 04 21:01:29.017326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 386/746] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:01:28 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:01:29.097490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:29.098148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:29.105483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.106538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.107169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.107993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.108615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.109167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.137212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:29.144426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:01:29.152928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:29.157593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:29.159545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90b6d31a-c47f-4c04-98ae-5ddffffb6f29 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.371902 Aug 04 21:01:29.160462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 361/747] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:28 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:29.307747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b5053024-f40e-47a5-8f9b-d5853cdaaf94 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 204 len: 0 microversion: 2.1 time: 0.213857 Aug 04 21:01:29.308634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 387/748] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:01:29 2022] DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:01:29.317669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:29.318487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:29.327048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.327785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.328527 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.329413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.330153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.330577 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.411059 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:29.411772 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:29.418517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.419429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.419899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.420636 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:29.421093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:29.421707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:29.487206 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:29.496287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad189be0-9772-48c8-8b83-a0d66898c0c9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1670 microversion: 2.1 time: 0.181740 Aug 04 21:01:29.497108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 362/749] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:29 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1670 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:29.598512 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:29.606915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-054dc004-7971-4551-a213-f8808ad65977 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.203281 Aug 04 21:01:29.607490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 388/750] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:29 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:30.181570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:30.186318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:30.194671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.195791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.196236 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.197248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.197724 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.198151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.224689 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:30.374530 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:30.384170 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:30.386611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:30.388001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8b6b06cc-0802-42c5-9976-22843bea8c99 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.210311 Aug 04 21:01:30.403800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 363/751] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:30 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:30.530226 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:30.531051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:30.538859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.539527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.540749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.541624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.542197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.543211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.628065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:30.629166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:30.636814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.637838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.638557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.640151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:30.641193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:30.642001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:30.817906 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:30.825603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a644bfcd-3ddc-4fd5-abb8-801fe95bfea9 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1670 microversion: 2.1 time: 0.305666 Aug 04 21:01:30.826506 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 389/752] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:30 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:30.928902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:30.950795 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc1d2940-2560-4566-b28f-9d41ae1e5eb7 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1522 microversion: 2.1 time: 0.324278 Aug 04 21:01:30.952960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 364/753] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:30 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:31.411200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:31.411797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:31.418531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.419018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.419445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.420132 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.420611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.421026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.455468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e24f4b7-a043-4e4c-b890-8afc32c415f2", "name": "network-vif-deleted", "tag": "f74916b5-02e1-46c5-8888-6a70ea5a98aa"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:31.467153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.467636 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.468068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.502391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] Creating event network-vif-deleted:f74916b5-02e1-46c5-8888-6a70ea5a98aa for instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 on hv-cinder-83602 Aug 04 21:01:31.524676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-c51d7daa-aa76-45d4-9718-76847100685e req-ee81cd09-ff3c-4ad8-9ed2-4be3dece5bb5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072514 Aug 04 21:01:31.530275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 365/754] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:01:31.644866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:31.660509 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:31.664026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:31.666080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-972696e9-0080-4be5-92b7-a44996fb60df tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1408 microversion: 2.20 time: 0.259120 Aug 04 21:01:31.668028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 390/755] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:31 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:31.847768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:31.848490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:31.855348 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.856113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.856762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.857647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.858100 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.858519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.973726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:31.974829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:31.987352 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.988425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.989014 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:31.989843 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:31.990549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:31.992544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:32.052371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:32.063589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8a6597d7-8695-4bfb-8936-11d743b2ac61 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1670 microversion: 2.1 time: 0.219878 Aug 04 21:01:32.064409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 366/756] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:31 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:32.144901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:32.157237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c344c3f6-bc00-4c31-865d-4e7746a30cd0 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1307 microversion: 2.1 time: 0.187661 Aug 04 21:01:32.159336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 391/757] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:31 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:32.689647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:32.702308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:32.713931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:32.714944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:32.715480 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:32.716470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:32.718553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:32.719309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.100828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:33.104209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:33.117350 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:33.119891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.122646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.123904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.124845 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.125725 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.126265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.137105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:33.152494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:33.155754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-52d9fdb3-6dcc-4698-9f39-b420ee2b738c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1599 microversion: 2.20 time: 0.469881 Aug 04 21:01:33.156922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 367/758] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:01:32 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1599 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:01:33.184167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:33.188109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:33.205972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.206469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.206925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.207682 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.208145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.208619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.243316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:33.263401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ef859cab-0465-46df-abad-d49f1bf1bcb6 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1605 microversion: 2.1 time: 0.180127 Aug 04 21:01:33.266241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 392/759] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:33 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1605 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:33.275785 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:33.278756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:33.296066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.297099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.297783 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.298808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.299528 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.300911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.326074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.327973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.330262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.330981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lazy-loading 'fault' on Instance uuid 6e24f4b7-a043-4e4c-b890-8afc32c415f2 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:33.490831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5026c90f0e3d49669c335ef542280409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b3821ed2f44e848959ac9d2683dab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:33.500938 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b90b8714-0632-4d70-8859-1960cfb7a226 tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 200 len: 1312 microversion: 2.1 time: 0.325734 Aug 04 21:01:33.501784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 368/760] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:33 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:33.506742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4eef31-8b60-4328-adde-046f701b8d15", "name": "network-vif-deleted", "tag": "91c963eb-7115-4422-87fd-8a3f75efd3d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:33.513424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b49b57fe-af0e-496f-95e2-f787793558a0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.245913 Aug 04 21:01:33.514137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 393/761] 10.222.0.52 () {60 vars in 1316 bytes} [Thu Aug 4 21:01:33 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:01:33.544907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:33.545521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:33.545963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:33.561907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] Creating event network-vif-deleted:91c963eb-7115-4422-87fd-8a3f75efd3d6 for instance cd4eef31-8b60-4328-adde-046f701b8d15 on hv-cinder-83602 Aug 04 21:01:33.578769 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0803df54-873b-4cb1-a936-61eb5ddbf633 req-850d0223-4617-4332-b8cc-0f245919337a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075354 Aug 04 21:01:33.589133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 369/762] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:34.286778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:34.288197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:34.299743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:34.301314 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:34.303855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:34.307288 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:34.308623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:34.309270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:34.388001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:34.388675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:34.389355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:34.389914 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lazy-loading 'fault' on Instance uuid cd4eef31-8b60-4328-adde-046f701b8d15 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:01:34.452920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:34.462889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b966ab41-2fc8-4a91-b6f4-9c5643809169 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 200 len: 1327 microversion: 2.1 time: 0.179931 Aug 04 21:01:34.466507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 394/763] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:34 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:34.534913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:34.536404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] [instance: 6e24f4b7-a043-4e4c-b890-8afc32c415f2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:34.555103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:34.557486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:34.559591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:34.560880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:34.567018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:34.567486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:34.601555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] HTTP exception thrown: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Request method failure captured: Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 HTTP/1.1 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIQNppqY5vBQmsM6c9o9J2g_L-miWgWjHtRPAL8pPfldZGlx-4byeGzbkV0np4zmqu6mbeZmw6uHp4EAxOtKZ0M7SNMI2CLd3OCkUfEo1Rm1w2147YPcI3vtQaT2l2lvssKcblCafFWxPsgIxp4h9jDuNkHa1R-dNUyzR13XzNSCU0 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:34.606834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71b3821ed2f44e848959ac9d2683dab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71b3821ed2f44e848959ac9d2683dab6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71b3821ed2f44e848959ac9d2683dab6"}]}] Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 71b3821ed2f44e848959ac9d2683dab6 Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-870595447 Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 5026c90f0e3d49669c335ef542280409 Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-870595447-project Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. Aug 04 21:01:34.608385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '6e24f4b7-a043-4e4c-b890-8afc32c415f2'} Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:34.609281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. Aug 04 21:01:34.610716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:34.613257 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] Returning 404 to user: Instance 6e24f4b7-a043-4e4c-b890-8afc32c415f2 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:34.614486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-204cf8cf-ced8-4892-b532-ceae27b7f09b tempest-ServerRescueNegativeTestJSON-870595447 tempest-ServerRescueNegativeTestJSON-870595447-project] 10.222.0.52 "GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2" status: 404 len: 111 microversion: 2.1 time: 0.093425 Aug 04 21:01:34.618946 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 370/764] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:34 2022] GET /compute/v2.1/servers/6e24f4b7-a043-4e4c-b890-8afc32c415f2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:35.489366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:35.489942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:35.500739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:35.501239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:35.501676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:35.505029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:35.505688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:35.506282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:35.547680 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 HTTP/1.1 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:35.553099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:01:35.554600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'cd4eef31-8b60-4328-adde-046f701b8d15'} Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:35.555379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:01:35.557676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:35.559091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:35.559091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-605c83bf-cd7e-475c-8fe6-b61c56c8eaae tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 404 len: 111 microversion: 2.1 time: 0.070605 Aug 04 21:01:35.559091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 395/765] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:35 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:35.564089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-37a793ff-be1a-4d01-a6cd-55e8979676c2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '.version_select at 0x7f2bd9e81040>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:35.590646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-37a793ff-be1a-4d01-a6cd-55e8979676c2 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766320930" status: 202 len: 0 microversion: 2.1 time: 0.030427 Aug 04 21:01:35.591227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 371/766] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Aug 4 21:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766320930 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:01:36.626705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:36.645874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:36.646351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:36.646782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:36.674929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] Creating event network-changed:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:01:36.681629 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-4f0765f2-7042-401c-93f1-0e848403d3ce req-63bcab3f-caa3-4227-8808-2e1b9ff019df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058521 Aug 04 21:01:36.683293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 396/767] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:37.182161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-272eb0b9-51cd-4e58-b336-8b32fbc71f55 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Action: 'create', calling method: .version_select at 0x7f2bd9f72f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-367343419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfmKQ12bR9wRxXzoJi1Ni5b8xJ8zsohUI1iIflgN9VQDQ7TZyEkYhU3ws1NYHvQEGBLvqjIVdMpbdr7gQJexkBf4qMMFAAjv5V1ttguqUosWaO05E5O7Void6bWHye4jw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:37.208371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-272eb0b9-51cd-4e58-b336-8b32fbc71f55 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:01:37.215672 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-272eb0b9-51cd-4e58-b336-8b32fbc71f55 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for user 3f4c9c7f2ddd4403b13696794dfaab5d and project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:01:37.257021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-272eb0b9-51cd-4e58-b336-8b32fbc71f55 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.295631 Aug 04 21:01:37.257637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 372/768] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 21:01:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:37.535054 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-35b5a3ea-e80c-4b1b-a279-232a4a47c3c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: .version_select at 0x7f2bda90edc0>, body: {"keypair": {"name": "tempest-keypair-1520077528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYRJvi8pJJMvzOu5qRpk3lSVedQwHVG+Md9BftmG1pTQpidHHKkgnS9zoB5bsY5k+yDdetpjP4ClnFOhDbapCwGCYJiuDnR8hJxYcA/TzUCiSegQb6BVl9cgWXuCKyYrw=="}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:37.559332 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-35b5a3ea-e80c-4b1b-a279-232a4a47c3c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:01:37.564875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-35b5a3ea-e80c-4b1b-a279-232a4a47c3c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for user 87929879b1c74efea0a390a3ce1a4006 and project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'key_pairs'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:01:37.597727 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-35b5a3ea-e80c-4b1b-a279-232a4a47c3c0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067573 Aug 04 21:01:37.618705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 397/769] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 21:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:39.766431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1051295601", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e9fd9f1-fbc3-4312-8e1c-f673ea000928"}], "security_groups": [{"name": "tempest-securitygroup--1688100292"}], "key_name": "tempest-keypair-1520077528", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:39.982548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] validate_networks() for [('4e9fd9f1-fbc3-4312-8e1c-f673ea000928', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:01:40.692332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:01:40.692879 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:01:40.693430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:01:40.694060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:01:40.694670 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:01:40.708010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:40.708890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:40.709436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:40.710436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:40.711118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:40.711948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:40.737786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:01:40.745413 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Getting quotas for user 87929879b1c74efea0a390a3ce1a4006 and project e6ea3d73695c4b3dba67b2da3a4df789. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:01:40.760295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:01:40.764499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:01:40.839666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6abc7e52-26d0-4c80-bedb-80787baa5551 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.076785 Aug 04 21:01:40.840867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 373/770] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:01:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:01:40.852547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ae9c565f-5c6e-4cc3-a33f-49b800aafc2c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:40.854053 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ae9c565f-5c6e-4cc3-a33f-49b800aafc2c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:40.984291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae9c565f-5c6e-4cc3-a33f-49b800aafc2c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:40.993109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ae9c565f-5c6e-4cc3-a33f-49b800aafc2c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1238 microversion: 2.1 time: 0.144862 Aug 04 21:01:40.994860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 398/771] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:40 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:42.016801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:42.017414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:42.025023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:42.025518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:42.025960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:42.027223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:42.027909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:42.028603 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:42.102632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:42.110282 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c0e3a736-0ad6-4fa3-8736-4e63e757047f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1290 microversion: 2.1 time: 0.097343 Aug 04 21:01:42.110864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 374/772] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:42 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:42.972973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c40b7840-b9ed-4d20-920a-7bf6af65b5d6 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Action: 'create', calling method: .version_select at 0x7f2bda8014c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-645961999", "metadata": {"Type": "work"}}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c40b7840-b9ed-4d20-920a-7bf6af65b5d6 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 121 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:42.986769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-645961999", "metadata": {"Type": "work"}}} Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:01:42.988679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-645961999', 'metadata': {'Type': 'work'}}}} Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:42.989576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:01:42.991183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:01:42.992577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:01:42.992577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:42.992577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c40b7840-b9ed-4d20-920a-7bf6af65b5d6 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:42.992577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c40b7840-b9ed-4d20-920a-7bf6af65b5d6 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.209134 Aug 04 21:01:42.992577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 399/773] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Aug 4 21:01:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:01:42.999750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e7d7a86-35f6-4a68-be9a-5f64143655f7 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Action: 'create', calling method: .version_select at 0x7f2bd9e81dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-441429101", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e7d7a86-35f6-4a68-be9a-5f64143655f7 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 119 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:43.004767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-441429101", "metadata": {"Type": "work"}}} Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: Aug 04 21:01:43.006255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-441429101', 'metadata': {'Type': 'work'}}}} Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi '0' Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:43.007474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:01:43.011627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:01:43.014457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:01:43.014457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.014457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e7d7a86-35f6-4a68-be9a-5f64143655f7 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:43.014457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e7d7a86-35f6-4a68-be9a-5f64143655f7 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011896 Aug 04 21:01:43.014457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 375/774] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Aug 4 21:01:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:01:43.018350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-af222d6f-b832-4062-91b7-193829ae274d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Action: 'create', calling method: .version_select at 0x7f2bda7c8c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2115486258", "metadata": {"Type": "work"}}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-af222d6f-b832-4062-91b7-193829ae274d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 119 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:43.022313 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2115486258", "metadata": {"Type": "work"}}} Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:01:43.023861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2115486258', 'metadata': {'Type': 'work'}}}} Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi '' Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:43.024866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:01:43.026211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:01:43.028074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:01:43.028074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.038716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-af222d6f-b832-4062-91b7-193829ae274d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:43.040357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-af222d6f-b832-4062-91b7-193829ae274d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027004 Aug 04 21:01:43.041169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 400/775] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Aug 4 21:01:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:01:43.053254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a72be41b-83ac-469d-acf3-6d4c47c54e1d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Calling method '.version_select at 0x7f2bd9dc79d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:43.090680 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-a72be41b-83ac-469d-acf3-6d4c47c54e1d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] HTTP exception thrown: Volume tempest-invalid-1372888018 could not be found. Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a72be41b-83ac-469d-acf3-6d4c47c54e1d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1372888018 HTTP/1.1 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:01:43.096761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Volume tempest-invalid-1372888018 could not be found. Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'tempest-invalid-1372888018'} Aug 04 21:01:43.098275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1372888018 could not be found. (HTTP 404) (Request-ID: req-d3037c20-799d-4e4e-be0e-0a28396b1918) Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.100970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:01:43.102289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1372888018 could not be found. Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:43.103745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1372888018 could not be found. Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1372888018 could not be found. Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a72be41b-83ac-469d-acf3-6d4c47c54e1d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 404 to user: Volume tempest-invalid-1372888018 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a72be41b-83ac-469d-acf3-6d4c47c54e1d tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1372888018" status: 404 len: 99 microversion: 2.1 time: 0.050272 Aug 04 21:01:43.105212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 376/776] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Aug 4 21:01:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1372888018 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:01:43.111205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-38a58612-6625-455e-bdf1-68ea1fa106de tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004991 Aug 04 21:01:43.111923 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 401/777] 10.222.0.52 () {58 vars in 1140 bytes} [Thu Aug 4 21:01:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:01:43.122766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f72e5c1f-de6f-4bff-afdf-a97a745744e9 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004733 Aug 04 21:01:43.123642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 377/778] 10.222.0.52 () {58 vars in 1137 bytes} [Thu Aug 4 21:01:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:01:43.134170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8d660ee3-5db8-4dc5-9890-b7ef3948e12a tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Calling method '.version_select at 0x7f2bda7f0dc0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:43.140579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:43.141600 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:43.150749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:43.151763 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:43.152466 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:43.153879 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:43.154528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:43.155146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:43.175945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-8d660ee3-5db8-4dc5-9890-b7ef3948e12a tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] HTTP exception thrown: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8d660ee3-5db8-4dc5-9890-b7ef3948e12a tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/os-volumes/11481a44-cbf3-4bf1-b487-54f9a83143fa HTTP/1.1 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:43.181138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '11481a44-cbf3-4bf1-b487-54f9a83143fa'} Aug 04 21:01:43.183991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. (HTTP 404) (Request-ID: req-9085a82c-e9f9-4b27-9377-21a92446c0e5) Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.185824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:01:43.188243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:01:43.193306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8d660ee3-5db8-4dc5-9890-b7ef3948e12a tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 404 to user: Volume 11481a44-cbf3-4bf1-b487-54f9a83143fa could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:43.196306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8d660ee3-5db8-4dc5-9890-b7ef3948e12a tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/11481a44-cbf3-4bf1-b487-54f9a83143fa" status: 404 len: 109 microversion: 2.1 time: 0.064012 Aug 04 21:01:43.199765 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 402/779] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:01:43 2022] DELETE /compute/v2.1/os-volumes/11481a44-cbf3-4bf1-b487-54f9a83143fa => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:43.205990 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5eae655b-b34f-4f3c-b781-535437b4bac3 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Calling method '.version_select at 0x7f2bdaae2e50>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:43.253069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:43.258279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-5eae655b-b34f-4f3c-b781-535437b4bac3 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] HTTP exception thrown: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5eae655b-b34f-4f3c-b781-535437b4bac3 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Request method failure captured: Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/os-volumes/cc11d95b-037d-4d3a-a659-461ccd9c9421 HTTP/1.1 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DO2y6bwFpVehPT87-KU8prELrDSpMPtm_Hrc2huYoRbPOCak5Ro7OW7jkG6l13CkRUN_WY2atH2whQRTGuWizwOBEV5ozLxWX6VcHAj-VJtG6sggusKGZa2FkTh6c-NVFdtVfFDmi55z6B_cxRLQqcKPqVp6vp7QHfkSP_7El4sL8I Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:01:43.261735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/969715bf5eeb4eb3b893237635545c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_969715bf5eeb4eb3b893237635545c33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/969715bf5eeb4eb3b893237635545c33"}]}] Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 969715bf5eeb4eb3b893237635545c33 Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesNegativeTest-1641416494 Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 7404b899f870415cbf64b6c9d5403632 Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesNegativeTest-1641416494-project Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'cc11d95b-037d-4d3a-a659-461ccd9c9421'} Aug 04 21:01:43.263270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. (HTTP 404) (Request-ID: req-af0fb6c2-5dcc-4c08-8a2e-4f14a03822fd) Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.264147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:01:43.265360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:01:43.266565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. Aug 04 21:01:43.267709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:01:43.269139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-36ceb34d-8f25-4452-a6d1-98912b696ba3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1296 microversion: 2.1 time: 0.128563 Aug 04 21:01:43.270143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5eae655b-b34f-4f3c-b781-535437b4bac3 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] Returning 404 to user: Volume cc11d95b-037d-4d3a-a659-461ccd9c9421 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:01:43.271205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5eae655b-b34f-4f3c-b781-535437b4bac3 tempest-VolumesNegativeTest-1641416494 tempest-VolumesNegativeTest-1641416494-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cc11d95b-037d-4d3a-a659-461ccd9c9421" status: 404 len: 109 microversion: 2.1 time: 0.070052 Aug 04 21:01:43.272110 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 403/780] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:01:43 2022] GET /compute/v2.1/os-volumes/cc11d95b-037d-4d3a-a659-461ccd9c9421 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:43.272579 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 378/781] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:43 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:44.285133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:44.286973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:44.296099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:44.297005 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:44.297508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:44.298278 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:44.298791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:44.301710 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:44.557766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a9ce6f-9344-4132-b198-015b744b564f", "tag": "e42bfeff-b661-4ccf-b383-fa6ded440952"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:44.575026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:44.578568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:44.579615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:44.580311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:44.594004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-03d5abc3-c47a-4948-b3a9-f2a97661b466 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.313943 Aug 04 21:01:44.594975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 404/782] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:44 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:44.603240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] Creating event network-changed:e42bfeff-b661-4ccf-b383-fa6ded440952 for instance 14a9ce6f-9344-4132-b198-015b744b564f on hv-cinder-83602 Aug 04 21:01:44.611203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e88b4568-5991-467b-9696-7f55e0471130 req-c1f8da53-6e4f-4e1e-8da5-742447f31987 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057650 Aug 04 21:01:44.612916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 379/783] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:01:45.616262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:45.616932 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:45.636608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:45.637446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:45.637974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:45.638836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:45.639408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:45.639892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:45.780547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:45.788426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1c402a39-0407-4b16-ab1d-0b76b9610777 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.177258 Aug 04 21:01:45.788996 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 405/784] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:45 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:46.817482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:46.818178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:46.820401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:46.828991 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:46.829625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:46.830069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:46.830775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:46.831232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:46.831661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:46.988641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:46.996833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae475893-252e-433d-b09c-590cd3fa88d7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.185579 Aug 04 21:01:46.997406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 380/785] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:46 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:48.020040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:48.022736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:48.033393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:48.034325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:48.037475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:48.038605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:48.044433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:48.045214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:48.215789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:48.223477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-992c32c9-f098-421b-bef0-48871d40ceed tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.207468 Aug 04 21:01:48.224051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 406/786] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:48 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:49.246981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:49.247590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:49.256887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:49.257468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:49.259303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:49.260116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:49.260748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:49.261261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:49.421392 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:49.430518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e98f01cd-199c-4333-b31e-4c5936dd8838 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.187463 Aug 04 21:01:49.436373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 381/787] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:49 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:50.452246 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:50.452963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:50.459922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:50.460537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:50.461039 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:50.461853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:50.462371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:50.462822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:50.610376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:50.618668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6a41e8f1-9947-49ff-ab3a-fd557b888431 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.171400 Aug 04 21:01:50.619994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 407/788] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:50 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:50.772716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a9ce6f-9344-4132-b198-015b744b564f", "name": "network-vif-plugged", "status": "completed", "tag": "e42bfeff-b661-4ccf-b383-fa6ded440952"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:50.778138 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:50.778858 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:50.785737 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:50.786301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:50.786864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:50.799710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] Creating event network-vif-plugged:e42bfeff-b661-4ccf-b383-fa6ded440952 for instance 14a9ce6f-9344-4132-b198-015b744b564f on hv-cinder-83602 Aug 04 21:01:50.805112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2c1310f7-0dcb-45f1-8a97-daf09ab89f95 req-900cc975-723e-4c33-8edf-d9078a61b972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Aug 04 21:01:50.806205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 382/789] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:51.642704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:51.643604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:51.645773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:51.652502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:51.652928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:51.653375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:51.654075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:51.654535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:51.654958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:51.841405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:51.848938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c5af535e-cc8d-4ffb-b112-cf1b012b2554 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.211183 Aug 04 21:01:51.849529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 408/790] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:51 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:52.870470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:52.871215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:52.877547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:52.878029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:52.878558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:52.879252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:52.879707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:52.880127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:53.044767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:53.052782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c66e7c94-e372-474f-8566-ed2033282140 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1364 microversion: 2.1 time: 0.186996 Aug 04 21:01:53.053346 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 383/791] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:52 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:01:54.073430 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:54.074064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:54.079945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:54.080460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:54.080895 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:54.081578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:54.082031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:54.082452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:54.215092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:01:54.218581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:54.223620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7b62c944-6dcf-464a-8ca0-4b13e846828f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1551 microversion: 2.1 time: 0.154130 Aug 04 21:01:54.224570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 409/792] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:01:54 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:01:54.245768 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:01:54.246286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:01:54.253374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:54.253864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:54.254308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:54.255006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:54.255471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:54.255901 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:54.334567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d53c0412-7022-4290-ae5f-b9a97282c2d3 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093360 Aug 04 21:01:54.335177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 384/793] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 21:01:54 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:01:55.542392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a9ce6f-9344-4132-b198-015b744b564f", "tag": "e42bfeff-b661-4ccf-b383-fa6ded440952"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:01:55.555799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:01:55.556558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:01:55.557829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:01:55.572061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] Creating event network-changed:e42bfeff-b661-4ccf-b383-fa6ded440952 for instance 14a9ce6f-9344-4132-b198-015b744b564f on hv-cinder-83602 Aug 04 21:01:55.577646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-e73fae6d-b9d9-4425-884b-79a3dd4ba91b req-0a9c4df4-2469-4a15-aeb2-48292ea38ebd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039658 Aug 04 21:01:55.578277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 410/794] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:03.019426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-237341202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367343419", "security_groups": [{"name": "tempest-secgroup-smoke-1969714044"}], "block_device_mapping_v2": [{"uuid": "e61f1685-afc1-4d86-a798-147a052205f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28abb33f-5ab1-4183-ab52-0944bb76f54a"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:03.136819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] validate_networks() for [('28abb33f-5ab1-4183-ab52-0944bb76f54a', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:02:03.541761 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:02:03.542354 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:02:03.542888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:02:03.543335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:02:03.543754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:02:03.552812 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:03.553305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:03.553740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:03.554472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:03.554933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:03.555360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:03.562471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=77 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:03.574571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:02:03.578601 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for user 3f4c9c7f2ddd4403b13696794dfaab5d and project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:02:03.637846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:02:03.639998 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e61f1685-afc1-4d86-a798-147a052205f5',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:02:03.772959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6c61511-c6d1-4144-94d4-c722f6ec8b93 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758103 Aug 04 21:02:03.773593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 385/795] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:02:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:02:03.786553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d94eeb15-db15-4509-a947-fab20dd2d6e6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:03.787465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d94eeb15-db15-4509-a947-fab20dd2d6e6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:03.791573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:03.860727 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d94eeb15-db15-4509-a947-fab20dd2d6e6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:03.868796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d94eeb15-db15-4509-a947-fab20dd2d6e6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1093 microversion: 2.1 time: 0.087054 Aug 04 21:02:03.869925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 411/796] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:03 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:04.890895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:04.891823 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:04.898039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:04.898662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:04.899309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:04.900072 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:04.900760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:04.901253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:04.975176 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:04.983940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8f50aef9-abc0-4a65-9547-3a17d86e0393 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1199 microversion: 2.1 time: 0.097439 Aug 04 21:02:04.984856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 386/797] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:04 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:06.005483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:06.006047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:06.008980 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:06.013397 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:06.014043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:06.014519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:06.015221 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:06.015679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:06.016101 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:06.155319 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:06.163258 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cca8f8bc-f188-47d0-88aa-0e6844f2809d tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1277 microversion: 2.1 time: 0.161648 Aug 04 21:02:06.163935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 412/798] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:06 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:06.276684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d281c9-228e-4aeb-8054-fb5ac796724e", "tag": "110bbd8a-2042-4a58-8a76-6a3ca4f3d460"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:06.298031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:06.298673 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:06.299331 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:06.314599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] Creating event network-changed:110bbd8a-2042-4a58-8a76-6a3ca4f3d460 for instance 46d281c9-228e-4aeb-8054-fb5ac796724e on hv-cinder-83602 Aug 04 21:02:06.320616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9e64b73f-859f-4d5f-a72b-d17f3f4b9a37 req-b635166d-8999-4abd-9d93-807a8eb8dc2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049502 Aug 04 21:02:06.321224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 387/799] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:07.185253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:07.185866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:07.191721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:07.192273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:07.192739 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:07.193434 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:07.193890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:07.194317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:07.330603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:07.338629 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c8f0211f-1371-419a-b703-fbdfbf7dd4e7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.157262 Aug 04 21:02:07.339395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 413/800] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:07 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:08.362202 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:08.362819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:08.369420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:08.369912 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:08.370361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:08.371059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:08.371522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:08.371953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:08.511314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:08.518971 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ee4063fd-bbac-4b8c-9e6b-40ae610c98ad tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.161592 Aug 04 21:02:08.519542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 388/801] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:08 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:09.164584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-431080968", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:09.216901 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] validate_networks() for None {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:02:09.490902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:02:09.491328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:02:09.491796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:02:09.492202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:02:09.492633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:02:09.502078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:09.502553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:09.502978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:09.503686 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:09.504143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:09.504600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:09.521089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Getting quotas for project 910c69679a094c3fba35a182c991accc. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:02:09.525529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Getting quotas for user 881fce4ba56a4454970886a4cc3b1dad and project 910c69679a094c3fba35a182c991accc. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:02:09.536257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:02:09.538635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:02:09.538922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:09.539535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:09.546781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:09.547271 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:09.547711 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:09.548504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:09.548965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:09.549393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:09.584775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5cf45ff8-8f3c-466d-8668-da1075aff078 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424092 Aug 04 21:02:09.585581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 414/802] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:02:09.596312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-370197d0-5504-47b9-978a-43e9cd1e125b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:09.596933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-370197d0-5504-47b9-978a-43e9cd1e125b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:09.658530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-370197d0-5504-47b9-978a-43e9cd1e125b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:09.668087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-370197d0-5504-47b9-978a-43e9cd1e125b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1214 microversion: 2.1 time: 0.075352 Aug 04 21:02:09.669056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 415/803] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:09 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:09.718607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:09.726251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2c1e717-2dc5-40ad-b49a-993aa126379e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.191158 Aug 04 21:02:09.726894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 389/804] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:09 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:10.688671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:10.689290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:10.696514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:10.698030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:10.698716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:10.699427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:10.699882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:10.700308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:10.747582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:10.748198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:10.755806 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:10.756328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:10.756791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:10.757658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:10.758310 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:10.758902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:10.775320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:10.784185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-4b80b4ba-d248-4190-9e4c-7e84d5dc5823 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1284 microversion: 2.1 time: 0.099064 Aug 04 21:02:10.785025 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 416/805] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:10 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:10.907071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:10.914571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d72dd6d2-27b5-4f19-9ff0-ab146ab37d45 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.171411 Aug 04 21:02:10.915137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 390/806] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:10 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:11.804922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:11.805486 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:11.811853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:11.812362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:11.812802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:11.813499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:11.814003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:11.814429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:11.935992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:11.936735 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:11.943982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:11.944688 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:11.945268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:11.946003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:11.946658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:11.947909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:11.953530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:11.961729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1cd74eac-b11c-48c2-ae15-702fdf1bc771 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.160722 Aug 04 21:02:11.963384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 417/807] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:11 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:12.089707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:12.097835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f0b42e3-881a-48e4-8783-d2daff1a0b95 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.166390 Aug 04 21:02:12.098512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 391/808] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:11 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:12.461122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3545bc-a4c3-414b-afa6-baf07ec07f52", "tag": "7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:12.472469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:12.472867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:12.473288 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:12.488152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] Creating event network-changed:7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04 for instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 on hv-cinder-83602 Aug 04 21:02:12.493024 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-33716d48-b654-4ac2-8aa7-35ef405f654a req-68aa62bd-f9fa-4990-9bd7-9196d6e3ee27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Aug 04 21:02:12.494158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 418/809] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:12.985426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:12.987294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:12.995083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:12.995565 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:12.996004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:12.996742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:12.997202 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:12.997627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:13.118429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:13.119966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:13.126026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:13.126591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:13.127023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:13.127709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:13.128156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:13.128596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:13.130470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:13.138704 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-136e0a86-7b81-47b9-a731-828a27741c02 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.157308 Aug 04 21:02:13.139562 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 392/810] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:12 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:13.262764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:13.270046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a5c80bd0-db8c-46ac-adf9-56dbeba8c093 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.155801 Aug 04 21:02:13.270612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 419/811] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:13 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:14.164299 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:14.165808 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:14.169148 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:14.170235 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:14.179999 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:14.180606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:14.181130 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:14.182273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:14.182943 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:14.183437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:14.290490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:14.291199 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:14.297128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:14.297615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:14.298054 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:14.298749 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:14.299208 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:14.299637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:14.324107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:14.331995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-addf2aae-7721-4b3a-bfdf-f57d4296dc5b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.175448 Aug 04 21:02:14.332633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 393/812] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:14 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:14.439104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:14.447166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e56ddb09-6fef-4349-bbbc-758c95853ad1 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.160023 Aug 04 21:02:14.447813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 420/813] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:14 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:15.355785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:15.356467 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:15.362899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:15.363384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:15.363821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:15.364559 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:15.365017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:15.365457 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:15.468623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:15.469306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:15.475987 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:15.476175 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:15.476748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:15.477453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:15.478599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:15.480107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:15.503547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:15.512496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b27893b7-7686-4f5f-a6f6-cf29f4b67b75 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.161383 Aug 04 21:02:15.513425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 394/814] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:15 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:15.617397 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:15.626151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f9d890c7-5100-40b7-a6e6-e1d566bbfc1e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.161601 Aug 04 21:02:15.626729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 421/815] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:15 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:16.534114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:16.534723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:16.541856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:16.542341 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:16.542779 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:16.543470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:16.543931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:16.544375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:16.647539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:16.648137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:16.654989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:16.655502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:16.655936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:16.656659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:16.657105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:16.657561 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:16.686876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:16.694937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-84dddf59-179e-447a-b38c-3b67b6d9ea25 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.164544 Aug 04 21:02:16.695721 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 395/816] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:16 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:16.796534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:16.805044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-361dfcb3-5f85-4400-b432-8dabd1c13dbc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.161173 Aug 04 21:02:16.806503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 422/817] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:16 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:17.050481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d281c9-228e-4aeb-8054-fb5ac796724e", "name": "network-vif-plugged", "status": "completed", "tag": "110bbd8a-2042-4a58-8a76-6a3ca4f3d460"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:17.058024 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:17.062887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:17.063449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:17.063951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:17.078865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] Creating event network-vif-plugged:110bbd8a-2042-4a58-8a76-6a3ca4f3d460 for instance 46d281c9-228e-4aeb-8054-fb5ac796724e on hv-cinder-83602 Aug 04 21:02:17.083820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8b19f96b-a721-4e6f-91e2-33ac77757a10 req-620b173d-1809-4200-9b8d-44f567371415 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039289 Aug 04 21:02:17.084465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 396/818] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:17.716242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:17.716828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:17.722676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:17.723152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:17.723580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:17.724253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:17.724728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:17.725145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:17.827613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:17.828306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:17.834346 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:17.834824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:17.835262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:17.835948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:17.836418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:17.836843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:17.857467 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:17.865389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7b97f99e-dd19-4861-8ee0-8d7c0d777f1d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.153563 Aug 04 21:02:17.866322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 423/819] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:17 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:17.977387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:17.985557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9df0892c-9bd3-4faf-99f0-87739f1f16e9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.162637 Aug 04 21:02:17.986129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 397/820] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:17 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:18.885304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:18.885909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:18.891639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:18.892115 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:18.892571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:18.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:18.893695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:18.894118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:19.006540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:19.007153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:19.014505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:19.015261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:19.015706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:19.016450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:19.016919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:19.017348 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:19.029280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:19.036692 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-68606d1e-3778-41d9-ac02-a0dcd207b69f tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.155139 Aug 04 21:02:19.037262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 424/821] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:18 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:19.154736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:19.162658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-17f5b38e-8e03-4626-806c-ce298f379602 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1265 microversion: 2.1 time: 0.160053 Aug 04 21:02:19.163608 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 398/822] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:19 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:20.058326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:20.058935 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:20.060900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:20.061594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=10 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:20.067613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.068100 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.068603 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.069344 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.069832 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.070308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.185123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:20.185821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:20.192465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.192961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.193405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.194106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.194570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.195001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.200385 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:20.208134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a1613ec5-0527-4585-ac31-40140b946279 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.154166 Aug 04 21:02:20.208773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 425/823] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:20 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:20.330746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:20.338854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fab83824-19c3-40d1-8c6f-32f1a3713d2e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1453 microversion: 2.1 time: 0.158285 Aug 04 21:02:20.339426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 399/824] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:20 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:20.359339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:20.359952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:20.365820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.366308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.366745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.367431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.367893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.369086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.498086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:20.505806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-91958634-a351-432f-81d3-a1266e71b87b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1453 microversion: 2.1 time: 0.150209 Aug 04 21:02:20.506381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 426/825] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:20 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:20.955502 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3545bc-a4c3-414b-afa6-baf07ec07f52", "name": "network-vif-plugged", "status": "completed", "tag": "7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:20.966904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:20.970474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:20.970474 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:20.984762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] Creating event network-vif-plugged:7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04 for instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 on hv-cinder-83602 Aug 04 21:02:20.990133 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-4ea8fa35-d650-425d-9184-bb627fb83189 req-3a8a95f8-f890-4b2c-b7ed-4fc7e344b41b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038346 Aug 04 21:02:20.990961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 400/826] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:02:21.229403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:21.230160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:21.236390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:21.236859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:21.237291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:21.237984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:21.238431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:21.238848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:21.376158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:21.383439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-78426d8c-8bb3-456b-a0df-f5624b1b3ec0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.158569 Aug 04 21:02:21.384828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 427/827] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:21 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:22.349965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d281c9-228e-4aeb-8054-fb5ac796724e", "tag": "110bbd8a-2042-4a58-8a76-6a3ca4f3d460"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:22.360393 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:22.360887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:22.361326 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:22.372574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] Creating event network-changed:110bbd8a-2042-4a58-8a76-6a3ca4f3d460 for instance 46d281c9-228e-4aeb-8054-fb5ac796724e on hv-cinder-83602 Aug 04 21:02:22.377974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-514e8396-df7b-432e-ba6a-f6b570b92aee req-57179b03-1bf2-431c-83f5-f919ec4ea8c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032536 Aug 04 21:02:22.378790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 401/828] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:22.405652 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:22.406261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:22.412154 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:22.412599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:22.413029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:22.413714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:22.414162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:22.414576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:22.560123 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:22.568962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3ee5d07e-36a3-4d7a-b9e8-42b1dff8071b tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1314 microversion: 2.1 time: 0.166836 Aug 04 21:02:22.569836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 428/829] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:22 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:23.590616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:23.591314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:23.597992 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.598472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.598904 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:23.599586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.600067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.600522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:23.730148 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:23.737629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-632f3850-b48d-4088-ad93-b71d4a7b08ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1463 microversion: 2.1 time: 0.151270 Aug 04 21:02:23.738327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 402/830] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:23 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:23.785399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:23.786044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:23.792185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.792709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.793143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:23.793830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.794287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.794719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:23.822038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:02:23.855679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:23.900642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1910dc1c-e475-42cd-a87f-41e92bc893ff tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 204 len: 0 microversion: 2.1 time: 0.118768 Aug 04 21:02:23.901233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 429/831] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:02:23 2022] DELETE /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:02:23.910114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:23.910720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:23.917387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.917877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.918313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:23.919003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:23.919458 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:23.919892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:24.056801 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:24.064265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c6e7ae63-07dc-41cb-8e6a-1f961c82406d tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1469 microversion: 2.1 time: 0.158140 Aug 04 21:02:24.064871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 403/832] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:23 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:02:25.087873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:25.088609 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:25.094695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:25.095187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:25.095729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:25.096525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:25.096988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:25.097416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:25.255741 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:25.263361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5b1d37a4-f8ad-462f-a33f-716ef3ded4d0 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1469 microversion: 2.1 time: 0.180165 Aug 04 21:02:25.263939 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 430/833] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:25 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:26.292263 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:26.296759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:26.306948 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3545bc-a4c3-414b-afa6-baf07ec07f52", "name": "network-vif-deleted", "tag": "7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:26.313643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:26.314247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:26.314799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:26.315624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:26.316219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:26.316894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:26.320113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:26.320625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:26.321160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:26.335366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] Creating event network-vif-deleted:7f2bb45c-fdec-4c3e-b92d-b9e7a3666a04 for instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 on hv-cinder-83602 Aug 04 21:02:26.342186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-77b24d46-4b0d-4fd0-8e73-365d7c57107c req-5d81b30a-080c-4587-9739-5313d1484080 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041875 Aug 04 21:02:26.343640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 431/834] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:26.408470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881fce4ba56a4454970886a4cc3b1dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910c69679a094c3fba35a182c991accc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:26.418184 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2ad20047-791b-4d03-a416-a7fa2521cf62 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 200 len: 1427 microversion: 2.1 time: 0.135788 Aug 04 21:02:26.419118 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 404/835] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:26 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:27.441837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:27.442575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] [instance: 2b3545bc-a4c3-414b-afa6-baf07ec07f52] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:27.450037 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:27.450523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:27.450957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:27.451651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:27.452105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:27.452571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:27.468987 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] HTTP exception thrown: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Request method failure captured: Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 HTTP/1.1 Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DPPpIpcu0McCIOX3Wesa78Xei5QBEgMYZxlizUp3MAcIqlj1qpf6q15uKLSuQqsuQDAKUSdM-4U2mPl_-c3Zwlkb9rcTLoNNMrb7-GqzoQoIhSqrnFM1LMyL9i6kgJJ0Wr3sHqRorGZc39yhAE6xhdOpKzrrqfueufj_9_0bvDG0NQ Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 910c69679a094c3fba35a182c991accc Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesNegativeTest-118247588 Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:02:27.470634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/910c69679a094c3fba35a182c991accc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/910c69679a094c3fba35a182c991accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_910c69679a094c3fba35a182c991accc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/910c69679a094c3fba35a182c991accc"}]}] Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesNegativeTest-118247588 Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 910c69679a094c3fba35a182c991accc Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesNegativeTest-118247588 Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesNegativeTest-118247588-project Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 881fce4ba56a4454970886a4cc3b1dad Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesNegativeTest-118247588-project Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. Aug 04 21:02:27.472316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '2b3545bc-a4c3-414b-afa6-baf07ec07f52'} Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:02:27.473337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. Aug 04 21:02:27.474622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:02:27.475782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] Returning 404 to user: Instance 2b3545bc-a4c3-414b-afa6-baf07ec07f52 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:02:27.475782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-261407c3-0105-4157-988a-fe470af873b4 tempest-VolumesNegativeTest-118247588 tempest-VolumesNegativeTest-118247588-project] 10.222.0.52 "GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52" status: 404 len: 111 microversion: 2.1 time: 0.034450 Aug 04 21:02:27.475782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 432/836] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:27 2022] GET /compute/v2.1/servers/2b3545bc-a4c3-414b-afa6-baf07ec07f52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:02:41.262910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:41.263469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:41.265570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=17 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:41.266212 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:41.272204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:41.272714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:41.273149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:41.273836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:41.274945 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:41.275362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:41.297936 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-619605f6-eab6-499d-8135-2adffe7a4b40 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/ips" status: 200 len: 151 microversion: 2.1 time: 0.039736 Aug 04 21:02:41.298490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 405/837] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:02:41 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:42.623303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fdd358e-170f-49f6-8b54-86b155e7a7ce"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:42.625610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:42.627775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:42.628433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:42.635272 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:42.635750 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:42.636180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:42.636887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:42.637339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:42.637754 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:42.937679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-85a078e6-f711-44df-9859-6ebbf02c3d5c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318042 Aug 04 21:02:42.938282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 433/838] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:02:42 2022] POST /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:02:50.464148 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fdd358e-170f-49f6-8b54-86b155e7a7ce"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:50.466589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:50.473063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.473543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.473975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.474656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.475105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.475528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.554811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments HTTP/1.1 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 74 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:02:50.557799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {"volumeAttachment": {"volumeId": "7fdd358e-170f-49f6-8b54-86b155e7a7ce"}} Aug 04 21:02:50.559404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '28bf7558-e193-499d-a67f-701ea32da4f0', 'body': {'volumeAttachment': {'volumeId': '7fdd358e-170f-49f6-8b54-86b155e7a7ce'}}} Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:50.560327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:50.561798 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 400 to user: Invalid volume: volume 7fdd358e-170f-49f6-8b54-86b155e7a7ce is already attached to instances: 28bf7558-e193-499d-a67f-701ea32da4f0 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e7902a10-8e98-459a-b08c-b9c2b68cfb2a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099840 Aug 04 21:02:50.563280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 406/839] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:02:50 2022] POST /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:02:50.624353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:50.624938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:50.631056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.631536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.631966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.632681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.633958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.634605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.713938 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'services' on Instance uuid 28bf7558-e193-499d-a67f-701ea32da4f0 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:02:50.826745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f2131a7f-ee91-4d5d-ac19-22c2d290f553 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments/7fdd358e-170f-49f6-8b54-86b155e7a7ce" status: 202 len: 0 microversion: 2.1 time: 0.207226 Aug 04 21:02:50.827681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 434/840] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:02:50 2022] DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments/7fdd358e-170f-49f6-8b54-86b155e7a7ce => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:02:50.836041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:50.838415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:50.845633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.846102 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.846609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.847324 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:50.847810 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:50.848275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:50.888722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2189d8a-fc16-4703-911c-de839efe81a3 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056592 Aug 04 21:02:50.889281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 407/841] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:02:50 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:51.901395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:51.903965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:51.910635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:51.911118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:51.911557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:51.912244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:51.912718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:51.913138 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:51.944029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8ce86e2c-df33-4cf6-8ff7-15ad019732ba tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047332 Aug 04 21:02:51.944639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 435/842] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:02:51 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:02:52.004880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:52.005452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:52.012606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:52.013101 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:52.013544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:52.014247 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:52.014707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:52.015137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:52.042890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:02:52.118947 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c584b56d-6c3b-4eb8-8c07-c0ced595b1d2 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 204 len: 0 microversion: 2.1 time: 0.117413 Aug 04 21:02:52.119616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 408/843] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:02:51 2022] DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:02:52.127971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:52.128621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:52.135003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:52.135511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:52.135958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:52.136676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:52.137135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:52.137562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:52.266824 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:52.275379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-abcc6e85-0a11-4af8-9c71-d8e180ed408d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1682 microversion: 2.1 time: 0.151326 Aug 04 21:02:52.275940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 436/844] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:52 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:53.297274 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:53.297965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:53.304660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:53.305902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:53.306339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:53.307177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:53.307750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:53.308297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:53.439859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:53.447591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2527af06-60b5-4886-8121-276931ed6263 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1682 microversion: 2.1 time: 0.154849 Aug 04 21:02:53.448156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 409/845] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:53 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:54.468744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:54.469354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:54.476092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:54.476722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:54.477062 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:54.477763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:54.478216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:54.478638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:54.611662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:54.620087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2d81b7bb-f28d-495b-9927-fb5d6d889b84 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1682 microversion: 2.1 time: 0.155098 Aug 04 21:02:54.620706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 437/846] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:54 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:55.465248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf7558-e193-499d-a67f-701ea32da4f0", "name": "network-vif-deleted", "tag": "d1f6d272-47a4-47d4-b13e-93cb2976eca5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:55.477635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:55.478203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:55.478702 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:55.491489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] Creating event network-vif-deleted:d1f6d272-47a4-47d4-b13e-93cb2976eca5 for instance 28bf7558-e193-499d-a67f-701ea32da4f0 on hv-cinder-83602 Aug 04 21:02:55.498182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-627fefd7-b88e-464b-9728-ab39559f864a req-7bea3784-2fcf-4dba-945e-3c374f820d80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036881 Aug 04 21:02:55.500172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 410/847] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:55.642214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:55.643428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:55.651610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:55.652384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:55.653320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:55.654442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:55.655134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:55.655960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:55.692507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:55.692962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:55.693401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:55.693922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'fault' on Instance uuid 28bf7558-e193-499d-a67f-701ea32da4f0 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:02:55.737570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:55.746597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-576d0475-95e0-42a2-bb67-9b598474baf6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 200 len: 1330 microversion: 2.1 time: 0.108277 Aug 04 21:02:55.747187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 438/848] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:55 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:02:56.767626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:56.768332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:56.775899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:56.776415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:56.776859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:56.777556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:56.778016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:56.778445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:56.792309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 HTTP/1.1 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:02:56.793950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:02:56.795713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '28bf7558-e193-499d-a67f-701ea32da4f0'} Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:02:56.796712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:02:56.798251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:02:56.799852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:02:56.799852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f22c371-840c-46d5-a36a-082c7487548a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 404 len: 111 microversion: 2.1 time: 0.031965 Aug 04 21:02:56.799852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 411/849] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:56 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:02:56.804473 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e10dcc54-9c56-4f40-b44f-ebfea2af04a5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '.version_select at 0x7f2bda745a60>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:56.823474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e10dcc54-9c56-4f40-b44f-ebfea2af04a5 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691621743" status: 202 len: 0 microversion: 2.1 time: 0.022774 Aug 04 21:02:56.824031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 439/850] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Aug 4 21:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691621743 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:02:57.440623 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f966110b-a30e-4d2e-96dc-052cca6a6d04 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: .version_select at 0x7f2bd9fa8700>, body: {"keypair": {"name": "tempest-keypair-850460194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0IIeAj5/sZdcuysDdIo75HPAML5Djevc00LyMquYlNdbdc8EyHnBxUPUSHFteVb2Jnc3zoIfc9MHL1J3ztCXWhBrqV3Cqhx+xCHQrAYqr4WxWHvcHX+uKefyT1Du8PDg=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:57.456510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f966110b-a30e-4d2e-96dc-052cca6a6d04 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:02:57.460306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f966110b-a30e-4d2e-96dc-052cca6a6d04 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:02:57.482192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f966110b-a30e-4d2e-96dc-052cca6a6d04 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045520 Aug 04 21:02:57.482784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 412/851] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Aug 4 21:02:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:02:58.747465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1690255014", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fc90a20-030f-4833-b078-8e1884210eeb"}], "security_groups": [{"name": "tempest-securitygroup--1692570311"}], "key_name": "tempest-keypair-850460194", "user_data": "}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:02:58.850622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] validate_networks() for [('2fc90a20-030f-4833-b078-8e1884210eeb', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:02:59.233283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:02:59.233704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:02:59.234202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:02:59.234618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:02:59.235023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:02:59.244178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:59.244699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:59.245143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:59.245933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:02:59.246642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:02:59.247071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:02:59.266535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:02:59.270457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Getting quotas for user 807855d862b146bdba009626f28d8d2f and project a5932111f3384861bfc778d561980e60. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:02:59.282349 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:02:59.284597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:02:59.338852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7471e993-cc95-40d7-9732-1dd16c74e336 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595882 Aug 04 21:02:59.340247 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 440/852] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:02:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:02:59.353045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed0902e1-844f-4bc1-bb5b-2f7e9d9b38f6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:02:59.353907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ed0902e1-844f-4bc1-bb5b-2f7e9d9b38f6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:02:59.420178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ed0902e1-844f-4bc1-bb5b-2f7e9d9b38f6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:02:59.427273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ed0902e1-844f-4bc1-bb5b-2f7e9d9b38f6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1241 microversion: 2.1 time: 0.079952 Aug 04 21:02:59.427875 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 413/853] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:02:59 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:00.449270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:00.450666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:00.457156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:00.457637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:00.458808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:00.459510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:00.460309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:00.461265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:00.529796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:00.537286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-632cad9e-cdc6-4307-ad2b-04b262d36c3a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1311 microversion: 2.1 time: 0.092588 Aug 04 21:03:00.537884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 441/854] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:00 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:01.559919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:01.560539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:01.567292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:01.567819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:01.568265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:01.569005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:01.569618 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:01.570054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:01.707799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:01.716478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a07fb6c8-f363-436a-b64a-eb512e9af280 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.160415 Aug 04 21:03:01.717065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 414/855] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:01 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:01.862582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9dc5c70-675d-4499-b815-cb8706745eca", "tag": "98c15788-6a93-46fe-87ff-c1196382389a"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:01.872656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:01.873417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:01.873870 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:01.885186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] Creating event network-changed:98c15788-6a93-46fe-87ff-c1196382389a for instance d9dc5c70-675d-4499-b815-cb8706745eca on hv-cinder-83602 Aug 04 21:03:01.890109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-204b0d0b-65e9-4578-9fe9-43c5a546b811 req-b3559bcb-a432-494e-b2f6-ae566470f9b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031324 Aug 04 21:03:01.890708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 442/856] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:02.738468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:02.739064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:02.746591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:02.747081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:02.747522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:02.748260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:02.748745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:02.749173 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:02.889149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:02.896723 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8511296f-f47a-4b6f-becd-d0879f98f0e8 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.162071 Aug 04 21:03:02.897301 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 415/857] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:02 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:03.918656 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:03.919374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:03.925747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:03.926227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:03.926659 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:03.927341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:03.927792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:03.928210 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:04.059639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:04.067105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a2a5c8b6-8b44-424a-98e1-c20d6158d3d7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.153580 Aug 04 21:03:04.067668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 443/858] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:03 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:04.930367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:04.930958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:04.936786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:04.937273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:04.937712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:04.938407 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:04.938866 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:04.939294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:04.963069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7a8f260f-48dd-41a5-8b8f-120985ef7b3e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/ips" status: 200 len: 150 microversion: 2.20 time: 0.036754 Aug 04 21:03:04.963648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 416/859] 10.222.0.52 () {60 vars in 1289 bytes} [Thu Aug 4 21:03:04 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:03:05.088653 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:05.089270 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:05.096125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:05.096838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:05.097296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:05.098177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:05.098666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:05.099176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:05.252113 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:05.262196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fd56d24f-0ed1-4df7-a801-fd379068b162 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.178280 Aug 04 21:03:05.263323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 444/860] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:05 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:06.287017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:06.287650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:06.294877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:06.295363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:06.296311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:06.296504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:06.296960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:06.297381 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:06.435192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:06.442811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-755cb66d-6b42-4e06-b395-cd284d0dcd88 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.159719 Aug 04 21:03:06.443367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 417/861] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:06 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:06.807481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:06.808069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:06.814675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:06.815158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:06.815596 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:06.816320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:06.816805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:06.817231 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:06.840361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lazy-loading 'flavor' on Instance uuid 69e55b14-4611-4cd7-902c-53f57144a536 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:03:07.030072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-327b45ce-b266-4c8e-adf4-deafbfe87602 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/action" status: 202 len: 0 microversion: 2.20 time: 0.225739 Aug 04 21:03:07.031743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 445/862] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Aug 4 21:03:06 2022] POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:07.040630 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:07.041255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:07.050796 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.051317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.051957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.052958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.053635 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.054065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.200074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:07.208709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:07.210336 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:07.212142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f1cba1b-be8c-490a-abd7-86a59b3e362c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.176113 Aug 04 21:03:07.212742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 418/863] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:07 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:07.465107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:07.465836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:07.472135 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.472807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.473184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.474071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.474616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.475044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.610323 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:07.619869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0386a607-e250-4917-b506-f6e8bdc62519 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.160006 Aug 04 21:03:07.620561 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 446/864] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:07 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:07.982205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:07.982782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:07.987460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:07.989598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.990258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.990772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.991549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.992135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.992745 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:07.997174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:07.997655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:07.998084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.009360 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] Creating event network-changed:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 21:03:08.014390 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-3936996e-931e-4e9c-a310-34c39c8e6822 req-929fbaf6-9698-4a15-be78-1899309b67d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030419 Aug 04 21:03:08.015038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 447/865] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:08.022770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:03:08.122850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ab5d19f-fa58-4f91-9950-dbf0227e97d8 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "DELETE /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 204 len: 0 microversion: 2.1 time: 0.144424 Aug 04 21:03:08.123867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 419/866] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:03:07 2022] DELETE /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:08.137193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:08.137969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:08.144899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.145380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.146022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.146784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.147304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.147811 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.153265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:08.237683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:08.238391 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:08.246222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.246783 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.247484 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.248327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.248890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.249649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.323764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:08.331820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-007b9a06-196a-4f29-a965-de94c230e418 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.201307 Aug 04 21:03:08.332742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 448/867] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:08 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:08.418809 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:08.427829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:08.430097 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:08.431670 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46e8a8ed-d25a-4db2-9b35-8d427983609e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.198572 Aug 04 21:03:08.432262 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 420/868] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:08 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:08.641374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:08.642713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:08.650643 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.651260 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.651632 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:08.652372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:08.652829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:08.653247 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.058825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:09.067157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6c17523c-800f-422d-824f-18e58f7e59a6 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.430409 Aug 04 21:03:09.067733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 449/869] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:08 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:09.143080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9dc5c70-675d-4499-b815-cb8706745eca", "name": "network-vif-plugged", "status": "completed", "tag": "98c15788-6a93-46fe-87ff-c1196382389a"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:09.154039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:09.154492 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:09.154894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.166280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] Creating event network-vif-plugged:98c15788-6a93-46fe-87ff-c1196382389a for instance d9dc5c70-675d-4499-b815-cb8706745eca on hv-cinder-83602 Aug 04 21:03:09.171141 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-fcb61eb7-7a2b-464d-b5e0-2f0d1ba3187f req-e7e695be-215d-4390-be72-a854ff543527 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Aug 04 21:03:09.171738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 421/870] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:09.354679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:09.355284 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:09.357162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:09.357809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:09.364442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:09.364921 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:09.365355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.366043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:09.366495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:09.367709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.451982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:09.456268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:09.457075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:09.463980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:09.464580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:09.465098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.465897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:09.466429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:09.466939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:09.505960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:09.515881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-112179ca-64be-4561-810d-c7501563f931 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.165190 Aug 04 21:03:09.516881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 450/871] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:09 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:09.624433 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:09.628757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:09.636450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:09.638035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:09.639223 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49987593-024d-4623-bb97-c70f7a70d290 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.188206 Aug 04 21:03:09.639782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 422/872] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:09 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:10.089392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:10.090000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:10.096302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.096818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.097251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.097997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.098449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.098868 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.248742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:10.256513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-31ac1bf9-61b3-42bf-a37f-e9b1201d9f8f tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.171928 Aug 04 21:03:10.257367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 451/873] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:10 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:10.537923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:10.538568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:10.545557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.546040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.546478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.547165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.547623 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.548046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.662045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:10.662651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:10.669019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.669502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.669947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.670638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:10.671096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:10.671518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:10.683585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:10.691068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3c12ec5c-c3a7-4ed0-805c-e9e4a60f92ef tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1566 microversion: 2.1 time: 0.157683 Aug 04 21:03:10.691630 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 423/874] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:10 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:10.835389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:10.843771 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:10.845306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:10.846458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-dccb1a5a-bf91-4a4e-a6a7-d414371a2af7 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.188280 Aug 04 21:03:10.847018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 452/875] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:10 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:11.276759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:11.277960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:11.280535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:11.287198 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.287856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.288281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.290127 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.290604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.291035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.520189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:11.529151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e6b2332d-9ba3-44d8-a93d-e8f89b7592f7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1367 microversion: 2.1 time: 0.256632 Aug 04 21:03:11.529949 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 424/876] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:11 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:11.713476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:11.714076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:11.723480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.724110 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.724582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.725303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.725766 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.727529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.790784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aff8d0-643a-43ac-b774-b9efab7310e6", "name": "network-vif-deleted", "tag": "91949beb-3441-4885-a662-b3f0b6cea93c"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:11.801983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.802471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.802909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.808718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:11.816067 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] Creating event network-vif-deleted:91949beb-3441-4885-a662-b3f0b6cea93c for instance 31aff8d0-643a-43ac-b774-b9efab7310e6 on hv-cinder-83602 Aug 04 21:03:11.816577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8bec620f-c037-499d-8862-177b5c25c090 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1380 microversion: 2.1 time: 0.107284 Aug 04 21:03:11.817047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 453/877] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:11 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:11.821209 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0021c7e5-cd72-4ad8-8463-7c1676122f0e req-744208b7-1976-4db7-982f-6d0eabfcb243 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Aug 04 21:03:11.821804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 425/878] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:03:11.869417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:11.870022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:11.876225 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.876748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.877196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:11.877885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:11.878343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:11.878769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.011787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:12.025762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:12.027245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:12.028641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3a9ce155-b475-4785-ad80-1f91e0cc5bcb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.163020 Aug 04 21:03:12.029198 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 454/879] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:11 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:12.551767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:12.552538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:12.558964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.559445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.559881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.560594 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.561049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.561470 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.695961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:12.703982 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-127a3536-d3a4-4e0a-a88e-badd55960332 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1557 microversion: 2.1 time: 0.156666 Aug 04 21:03:12.704819 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 426/880] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:12 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:12.726777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:12.727322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:12.729339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:12.735381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.735865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.736837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.737560 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.738012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.738433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.824218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-23df2053-4a74-4862-b5f7-3b6b72b3a55d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101861 Aug 04 21:03:12.825124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 455/881] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Aug 4 21:03:12 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:12.840116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:12.841105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:12.848616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.849109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.849560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.850265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.850724 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.851208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.881993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:12.883044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:12.883486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:12.883940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lazy-loading 'fault' on Instance uuid 31aff8d0-643a-43ac-b774-b9efab7310e6 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:03:12.967907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6398ec15831f40bfb1b316070a78adba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dee6a2bfb44b53924cf6d76c5fba12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:12.975428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d069657a-734e-4152-8542-39c6c135eef3 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 200 len: 1223 microversion: 2.1 time: 0.140549 Aug 04 21:03:12.976451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 427/882] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:12 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:13.052365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:13.052982 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:13.060463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:13.061239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:13.061680 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:13.062375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:13.062829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:13.063254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:13.335227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:13.344514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:13.347014 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:13.348227 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-494f9f3a-5184-48c3-bfdd-9eb0d8683588 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.300019 Aug 04 21:03:13.348840 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 456/883] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:13 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:13.908717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9dc5c70-675d-4499-b815-cb8706745eca", "tag": "98c15788-6a93-46fe-87ff-c1196382389a"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:13.920587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:13.921069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:13.921686 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:13.937960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] Creating event network-changed:98c15788-6a93-46fe-87ff-c1196382389a for instance d9dc5c70-675d-4499-b815-cb8706745eca on hv-cinder-83602 Aug 04 21:03:13.942993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-5479e754-bb54-4da6-8760-5c1ff9f1b45d req-e1128693-0ca5-42eb-9082-c755a196e821 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038141 Aug 04 21:03:13.943935 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 428/884] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:13.995747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:13.996630 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] [instance: 31aff8d0-643a-43ac-b774-b9efab7310e6] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:14.003185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:14.003676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:14.004118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:14.004854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:14.005312 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:14.005747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:14.020508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] HTTP exception thrown: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Request method failure captured: Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 HTTP/1.1 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DKb-hSzQQXR88qIIhqFPFT0TEZ9fISPLHr2RWYSSaF-DSXsSr8L3PUvwk792vkDJRRzg-Qg49eakKLln7Td5gVJvNU6TeuBgx2GOu5raLM1dxFD0neSfBdBw9VNqvC1nY59QCHSXBTHLAjaC_bXk1dG0E65jzsqDEgg0ltHtdkJTFc Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5dee6a2bfb44b53924cf6d76c5fba12 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-TestShelveInstance-1673346409 Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:03:14.022374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5dee6a2bfb44b53924cf6d76c5fba12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5dee6a2bfb44b53924cf6d76c5fba12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5dee6a2bfb44b53924cf6d76c5fba12", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5dee6a2bfb44b53924cf6d76c5fba12"}]}] Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-TestShelveInstance-1673346409 Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5dee6a2bfb44b53924cf6d76c5fba12 Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-TestShelveInstance-1673346409 Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-TestShelveInstance-1673346409-project Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 6398ec15831f40bfb1b316070a78adba Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-TestShelveInstance-1673346409-project Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. Aug 04 21:03:14.024403 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '31aff8d0-643a-43ac-b774-b9efab7310e6'} Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:03:14.025286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. Aug 04 21:03:14.026617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:03:14.027755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Returning 404 to user: Instance 31aff8d0-643a-43ac-b774-b9efab7310e6 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:03:14.027755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1450f664-83b6-4d45-be31-af5b6c4ee9a0 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6" status: 404 len: 111 microversion: 2.1 time: 0.032690 Aug 04 21:03:14.027755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 457/885] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:03:13 2022] GET /compute/v2.1/servers/31aff8d0-643a-43ac-b774-b9efab7310e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:03:14.217303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f9c8ab23-b581-4249-8842-bb985e7b17e1 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] Calling method '.version_select at 0x7f2bd9dc7940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:14.240995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f9c8ab23-b581-4249-8842-bb985e7b17e1 tempest-TestShelveInstance-1673346409 tempest-TestShelveInstance-1673346409-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-468663904" status: 202 len: 0 microversion: 2.1 time: 0.027644 Aug 04 21:03:14.242231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 429/886] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-468663904 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:03:14.374605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:14.375622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:14.385070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:14.385800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:14.386406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:14.387997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:14.389125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:14.390032 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:14.718620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:14.733290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:14.735167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:14.736588 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fd811945-792a-402c-9bb8-b90d3d856a97 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.368155 Aug 04 21:03:14.737537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 458/887] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:14 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:15.763905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:15.764749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:15.772137 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:15.772726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:15.773813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:15.775029 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:15.775495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:15.776109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:15.931110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:15.940069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:15.941621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:15.942851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4f812a86-af98-467a-b5f4-271b3b721a84 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.184714 Aug 04 21:03:15.943412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 430/888] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:15 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:16.971349 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:16.974088 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:16.983913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:16.984668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:16.985401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:16.986621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:16.987222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:16.987743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:17.237688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:17.245849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:17.247365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:17.249157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a670045a-8cd1-420d-8929-6128de2f49fb tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.284094 Aug 04 21:03:17.250158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 459/889] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:16 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:18.275844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:18.276485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:18.285156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:18.285650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:18.286208 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:18.287114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:18.287568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:18.287990 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:18.421489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:18.430016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:18.431677 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:18.432923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e39b16d4-c240-416c-92c5-908158a6a23f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.161812 Aug 04 21:03:18.433490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 431/890] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:18 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:19.455658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:19.456407 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:19.463222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:19.463719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:19.464157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:19.464875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:19.465330 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:19.465747 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:19.610455 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:19.619724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:19.621655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:19.623038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-bf830574-58e7-4058-bfae-6ed7dc7c6e36 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1744 microversion: 2.20 time: 0.171256 Aug 04 21:03:19.624205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 460/891] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:19 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:20.647232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:20.648501 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:20.655850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:20.656330 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:20.656787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:20.657473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:20.659079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:20.659079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:20.824188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:20.833747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:20.835838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:20.837823 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-acc2d03e-ae80-4575-b708-cb3c58bbba5b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1744 microversion: 2.20 time: 0.194466 Aug 04 21:03:20.838609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 432/892] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:20 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:21.862038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:21.862697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:21.869169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:21.869646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:21.870111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:21.870806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:21.871263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:21.871682 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:22.027530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:22.035531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:22.037046 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:22.038242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8985ae9f-e960-492d-9196-e357663381e1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1744 microversion: 2.20 time: 0.179966 Aug 04 21:03:22.038877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 461/893] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:21 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:23.062387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:23.062997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:23.070034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:23.070645 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:23.071215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:23.071931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:23.072424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:23.072857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:23.208790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:23.211916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "name": "network-vif-plugged", "status": "completed", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:23.219101 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:23.221370 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:23.222800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8dd49a97-82c2-4358-a9cb-57ff22fc7b7b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1744 microversion: 2.20 time: 0.164391 Aug 04 21:03:23.223740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 433/894] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:23 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:23.224023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:23.224625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:23.225065 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:23.238370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] Creating event network-vif-plugged:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:03:23.245848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-1056bfd1-c6b9-4a59-b446-2aed7078b3db req-47c776fa-2a97-46b7-9c96-2d683bcd00d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038399 Aug 04 21:03:23.246900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 462/895] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:23.328013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:23.328729 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:23.337291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:23.337775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:23.338316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:23.339018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:23.339477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:23.339903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:23.363441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eec89929-4f4a-48e7-b791-30ab33d0163d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/ips" status: 200 len: 145 microversion: 2.1 time: 0.039989 Aug 04 21:03:23.364012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 434/896] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:03:23 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:24.255555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:24.256170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:24.262492 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:24.262970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:24.263401 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:24.264082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:24.264571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:24.265017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:24.396701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:24.406698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:24.408189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:24.409516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c4d01450-b911-42ec-af0f-4fc00a71f719 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1744 microversion: 2.20 time: 0.158731 Aug 04 21:03:24.410075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 463/897] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:24 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:25.434701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:25.435574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:25.442119 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:25.442596 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:25.443030 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:25.443734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:25.444214 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:25.444802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:25.794202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f20b14a3-e4cc-43d2-8e40-420d2ef98947"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:25.797380 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:25.805181 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:25.806242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:25.806242 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:25.806968 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:25.807519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:25.807929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:25.885699 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:25.895902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:25.898778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:25.900211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b0e7caf1-865c-4e5d-9d99-e61858a7e728 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.469996 Aug 04 21:03:25.901271 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 435/898] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:25 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:26.155136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6ee7b626-5bc2-4260-bf23-edd5f5a285f0 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367463 Aug 04 21:03:26.156022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 464/899] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:03:25 2022] POST /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:26.940803 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:26.941506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:26.949152 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:26.949841 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:26.950352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:26.951135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:26.951792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:26.952307 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:27.109109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:27.118155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:27.119908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:27.121106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85525cc9-65a8-49e1-be4f-8846a6f6bcdc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.185568 Aug 04 21:03:27.121662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 436/900] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:26 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:28.146325 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:28.147025 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:28.155007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:28.155813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:28.156252 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:28.156981 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:28.157491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:28.157946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:28.174447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:28.311389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:28.320331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:28.322239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:28.323538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3a72b3f4-00fc-44fc-b3bf-8834e5da3cc1 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.181695 Aug 04 21:03:28.324395 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 465/901] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:28 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:29.347907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:29.348558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:29.357399 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:29.357906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:29.358352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:29.359079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:29.359545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:29.359980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:29.511738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:29.521882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:29.523876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:29.525383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c0325e81-6194-4abc-886e-99beee109edc tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.181516 Aug 04 21:03:29.539415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 437/902] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:29 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:30.549874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:30.551370 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:30.560728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:30.561585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:30.562263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:30.563040 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:30.563752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:30.564202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:30.724068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:30.733160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:30.734670 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:30.735860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8cc840a7-1a31-4901-a9cc-25e14152e434 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.190529 Aug 04 21:03:30.736635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 466/903] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:30 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:31.759962 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:31.760624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:31.767138 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:31.767633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:31.768080 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:31.768814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:31.769279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:31.769707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:31.911229 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:31.920951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:31.922574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:31.924004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-94b868a7-f1c6-457d-9993-bad7007f9976 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.168179 Aug 04 21:03:31.925782 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 438/904] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:31 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:32.949873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:32.951087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:32.957721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:32.958419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:32.958857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:32.959814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:32.961060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:32.961498 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:33.125375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:33.135010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:33.137459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:33.139074 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ae3cf5df-210e-4f66-bafd-367b341cd233 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.193201 Aug 04 21:03:33.139886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 467/905] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:32 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:33.849142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:33.852468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:33.859356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:33.859903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:33.860550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:33.861551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:33.862014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:33.862465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:33.896252 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9a53b988-bfac-4f32-9461-06e4a7b9ebf1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051381 Aug 04 21:03:33.897834 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 439/906] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:03:33 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:33.913433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:33.913986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:33.924646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:33.925839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:33.927087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:33.927931 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:33.928885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:33.929676 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:33.965148 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2a8c13c5-f5e3-46ce-9b2d-dcfb440d7ff8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947" status: 200 len: 194 microversion: 2.1 time: 0.056592 Aug 04 21:03:33.974042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 468/907] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Aug 4 21:03:33 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:34.166012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:34.167020 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:34.195376 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:34.196604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:34.197927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:34.199899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:34.202302 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:34.203316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:34.431040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:34.439711 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:34.441816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:34.443582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4690a615-2bb4-4fa9-9b21-8b1416b1a8f6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.284162 Aug 04 21:03:34.444889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 440/908] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:34 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:35.449459 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c6162bf-9293-4d3c-b3fb-d79a787731f8"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:35.452675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:35.460488 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:35.461293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:35.461832 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:35.462769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:35.463394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:35.463838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:35.469852 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:35.470677 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:35.477524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:35.478367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:35.479356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:35.481140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:35.481851 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:35.482609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:35.644652 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:35.649843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:35.656437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:35.658428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:35.659867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ca52211f-6db4-4841-b735-517be854cfa8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.194388 Aug 04 21:03:35.660662 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 441/909] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:35 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:03:35.817061 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-579f2476-f546-471e-a5a4-8e8b5a7d1f28 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "POST /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371907 Aug 04 21:03:35.817966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 469/910] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:03:35 2022] POST /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:36.686335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:36.686975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:36.704963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:36.705607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:36.706172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:36.707042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:36.707598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:36.708105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:36.885121 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:36.892940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:36.894444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:36.895614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-841db415-24ea-44d4-a8b4-a407de7f7997 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1739 microversion: 2.20 time: 0.213358 Aug 04 21:03:36.896178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 442/911] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:36 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:37.919957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:37.920681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:37.937708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:37.938206 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:37.938703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:37.939675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:37.940140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:37.940595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:38.148121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:38.156235 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:38.157856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:38.159018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3bbce985-eee6-4283-a476-f3b758669f92 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1721 microversion: 2.20 time: 0.243387 Aug 04 21:03:38.159575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 470/912] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:37 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:39.183386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:39.183993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:39.190505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:39.190988 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:39.191428 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:39.192113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:39.192591 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:39.193019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:39.332856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:39.341195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:39.342707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:39.343874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7b187658-3e0a-4f1b-8e9e-611db9a58a6c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1721 microversion: 2.20 time: 0.164603 Aug 04 21:03:39.344454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 443/913] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:39 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:40.366478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:40.367729 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:40.374381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.374874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.375318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:40.376020 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.376523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.376953 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:40.511268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:40.519361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:40.520894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:40.522944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fe0734bb-be77-4037-a14d-ee920803b075 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1724 microversion: 2.20 time: 0.159467 Aug 04 21:03:40.523746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 471/914] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:40 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:40.546882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca5caa11-a354-427f-8da7-fc6d86f046e9"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:40.549582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:40.556440 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.556928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.557367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:40.558053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.558506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.558946 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:40.837609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-536ab3eb-fb6f-464d-801b-7204e00695ad tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294786 Aug 04 21:03:40.838205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 444/915] 10.222.0.52 () {62 vars in 1364 bytes} [Thu Aug 4 21:03:40 2022] POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:03:40.960201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:40.960726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:40.968058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.968718 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.969155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:40.969928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:40.970384 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:40.970808 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.223265 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d5a76a17-c240-4cd8-b6af-2311e6125d42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments/ca5caa11-a354-427f-8da7-fc6d86f046e9" status: 202 len: 0 microversion: 2.20 time: 0.267522 Aug 04 21:03:41.223958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 472/916] 10.222.0.52 () {60 vars in 1457 bytes} [Thu Aug 4 21:03:40 2022] DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments/ca5caa11-a354-427f-8da7-fc6d86f046e9 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:41.244038 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "name": "network-vif-unplugged", "status": "completed", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:41.254406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:41.254827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:41.255265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.267187 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.compute.server_external_events [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] Unable to find a host for instance 69e55b14-4611-4cd7-902c-53f57144a536. Dropping event network-vif-unplugged {{(pid=124350) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 21:03:41.268098 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-3c3092bc-bb2f-49e5-ad7a-28cc64318558 req-7604fe2b-b1ee-47c9-88d8-9fe95b848f10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027925 Aug 04 21:03:41.268727 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 445/917] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 21:03:41.287416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:03:41.288302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:41.294295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:41.294787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:41.295215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.295899 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:41.296365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:41.296787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.341731 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124352) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:03:41.408584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-796e04f1-ec2c-458e-b576-38af0086ee14 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/action" status: 202 len: 0 microversion: 2.20 time: 0.125149 Aug 04 21:03:41.409287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 473/918] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Aug 4 21:03:41 2022] POST /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:41.417528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:41.418139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:41.420253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.425729 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:41.426216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:41.426651 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.427349 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:41.427800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:41.428263 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:41.597820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:41.606227 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:41.607714 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:41.608907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-03190384-3afa-420d-8af6-e0046df2da1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1672 microversion: 2.20 time: 0.195265 Aug 04 21:03:41.609465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 446/919] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:41 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:42.636223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:42.636871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:42.642818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:42.643295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:42.643730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:42.644433 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:42.644887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:42.645305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:42.773694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:42.781545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:42.782951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:42.784079 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e413b9fd-8bf5-431d-bf59-442d34378da0 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1674 microversion: 2.20 time: 0.153280 Aug 04 21:03:42.784657 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 474/920] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:42 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:43.374575 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:43.376878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:43.384225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.384736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.385167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.385864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.386312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.386730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.419367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7ea679cb-cc46-4403-9cd4-8b14b8c014b8 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048718 Aug 04 21:03:43.419963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 447/921] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:03:43 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:43.561551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:43.561952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:43.563893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:43.570048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.570189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.570625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.571331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.571787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.572399 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.603717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1430cf80-3ce6-444c-a9f0-a3b8014173b1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947" status: 200 len: 194 microversion: 2.1 time: 0.046125 Aug 04 21:03:43.604315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 475/922] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Aug 4 21:03:43 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:43.614423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:43.614912 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:43.621369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.621947 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.622463 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.623174 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.623640 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.624076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.706036 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lazy-loading 'services' on Instance uuid 14a9ce6f-9344-4132-b198-015b744b564f {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:03:43.781042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd816c72-7808-428c-a38f-ea76cad6ff27 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947" status: 202 len: 0 microversion: 2.1 time: 0.170254 Aug 04 21:03:43.781639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 448/923] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:03:43 2022] DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/f20b14a3-e4cc-43d2-8e40-420d2ef98947 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:03:43.809891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:43.810504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:43.817236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.817547 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.818112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:43.819746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:43.820205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:43.820860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:44.039122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:44.047085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:44.048637 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:44.050191 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5bfc69ba-ecac-4461-b03a-3f45986c824e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.245799 Aug 04 21:03:44.050817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 476/924] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:43 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:45.074585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:45.075294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:45.091025 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:45.091891 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:45.092707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:45.093626 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:45.094291 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:45.094924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:45.276465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:45.285710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:45.287483 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:45.289968 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5feef781-8fd6-45f9-8cf3-c8e699752775 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.220538 Aug 04 21:03:45.290816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 449/925] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:45 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:45.968784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:45.969361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:45.976965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:45.977818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:45.978458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:45.979358 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:45.980016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:45.980668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:45.983627 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.017142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a2169a84-e1a0-4687-a121-6671cff548fb tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/3c6162bf-9293-4d3c-b3fb-d79a787731f8" status: 200 len: 194 microversion: 2.1 time: 0.052203 Aug 04 21:03:46.018190 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 477/926] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Aug 4 21:03:45 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/3c6162bf-9293-4d3c-b3fb-d79a787731f8 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:03:46.029535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:46.030240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:46.036523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:46.037017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:46.037716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:46.038424 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:46.038886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:46.039318 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:46.132873 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lazy-loading 'services' on Instance uuid 14a9ce6f-9344-4132-b198-015b744b564f {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:03:46.221321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7126e618-b4cc-4a5c-8b10-3fbce9c75a4f tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/3c6162bf-9293-4d3c-b3fb-d79a787731f8" status: 202 len: 0 microversion: 2.1 time: 0.195409 Aug 04 21:03:46.222299 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 450/927] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:03:46 2022] DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments/3c6162bf-9293-4d3c-b3fb-d79a787731f8 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:03:46.314886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:46.315957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:46.323759 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:46.324633 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:46.325368 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:46.326287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:46.326969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:46.327604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:46.470534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:46.479013 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:46.480527 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:46.481667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c2c87fe9-cc19-4ee9-b344-8dc42b3699de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.171379 Aug 04 21:03:46.482228 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 478/928] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:46 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:47.506180 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:47.506866 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:47.513087 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:47.513574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:47.514017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:47.514706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:47.515168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:47.515596 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:47.657811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:47.667590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:47.669166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:47.670569 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6dd760e8-2467-4ccd-ae95-fd707b03a4f2 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.169187 Aug 04 21:03:47.685359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 451/929] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:47 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:48.695099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:48.695688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:48.702184 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:48.702667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:48.703102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:48.703787 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:48.704245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:48.704694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:48.842004 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:48.849816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:48.851284 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:48.852448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-97b90144-b747-4f2a-bd4a-ed4c26602dd5 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.161276 Aug 04 21:03:48.853002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 479/930] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:48 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:49.875211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:49.875933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:49.883464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:49.884043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:49.884585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:49.885359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:49.885893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:49.886375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:50.026128 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:50.034104 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:50.035646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:50.036839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b114984f-bf7f-450d-ab5b-ccdd5716c004 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.165604 Aug 04 21:03:50.038143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 452/931] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:49 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:51.061133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:51.061745 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:51.069525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:51.070375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:51.071075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:51.072007 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:51.072716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:51.073378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:51.216516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:51.225543 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:51.227147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:51.228301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-35275611-56c8-44b7-8f76-e9abb5bb6441 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.171819 Aug 04 21:03:51.228876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 480/932] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:51 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:52.252907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:52.253617 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:52.263556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:52.264057 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:52.264547 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:52.265406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:52.265880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:52.266382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:52.418994 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:52.427140 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:52.429558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:52.430203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1eebcb4d-1060-4dd8-bd70-448f60420e8f tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.181447 Aug 04 21:03:52.444734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 453/933] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:52 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:53.459902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:53.461491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:53.468487 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:53.468975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:53.469411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:53.470112 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:53.470562 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:53.470988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:53.612166 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:53.620704 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:53.622213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:53.623364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a63d3a0f-db9e-4902-996b-8b3726403c07 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.168159 Aug 04 21:03:53.623916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 481/934] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:53 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:54.646105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:54.646947 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:54.653716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:54.654269 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:54.654712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:54.655421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:54.655880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:54.656309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:54.801650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:54.810327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:54.811865 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:54.813058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f53b21d2-b68f-4ab4-be1a-a683ef2bf1ea tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.170841 Aug 04 21:03:54.813648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 454/935] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:54 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:55.837017 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:55.837683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:55.844149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:55.844681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:55.845119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:55.845811 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:55.846267 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:55.846741 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:55.978156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:55.986501 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:55.987998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:55.989182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c34c11c8-ee58-4304-9e3e-7c97e300ed65 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.156730 Aug 04 21:03:55.989736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 482/936] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:55 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:57.012508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:57.013093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:57.019461 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:57.019939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:57.020389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:57.021105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:57.021603 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:57.022027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:57.025991 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.156293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:57.165667 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:57.167182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:57.168418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3fd39bee-17a0-4200-b882-d69c982b37da tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.159747 Aug 04 21:03:57.169027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 455/937] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:57 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:58.192281 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:58.192861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:58.199291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:58.199777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:58.200214 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:58.200931 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:58.201392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:58.201820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:58.338668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:58.346530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:58.348015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:58.349286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c408fc3d-47e9-497f-8e7f-bf6dd303d82c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.160949 Aug 04 21:03:58.350847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 483/938] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:58 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:03:59.372108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:03:59.373173 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:03:59.379879 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:59.380489 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:59.381019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:59.381753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:03:59.382254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:03:59.382683 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:03:59.522847 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:59.530814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:59.532454 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:03:59.533621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c1671f7c-6bf0-4912-aed4-1a8536ab2bd8 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.165465 Aug 04 21:03:59.536384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 456/939] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:03:59 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:00.556908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:00.557499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:00.563963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:00.564474 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:00.564908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:00.565589 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:00.566033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:00.566450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:00.703750 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:00.712357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:00.713775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:00.714919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9d530661-7530-4f20-a682-bf814e020c42 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.162090 Aug 04 21:04:00.715467 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 484/940] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:00 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:01.738712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:01.739328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:01.746355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:01.746846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:01.747289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:01.747986 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:01.748479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:01.748910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:01.876684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:01.885298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:01.886800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:01.887964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6318203b-9f30-4eac-86e9-2b8a600ef4ec tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.153244 Aug 04 21:04:01.888549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 457/941] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:01 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:02.272986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:02.275286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:02.281928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.282414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.282848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.283540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.283994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.284452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.314460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1f62b205-73f1-4baa-82a1-9b670ca27556 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045393 Aug 04 21:04:02.315048 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 485/942] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:02 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:04:02.430511 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:02.432848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:02.439177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.439668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.440114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.440845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.441308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.441774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.473755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c7336052-6cba-432a-8bcc-23e81739d03a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047757 Aug 04 21:04:02.474340 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 458/943] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:02 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:04:02.538988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:02.539490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:02.545727 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.546258 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.546696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.547393 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.547851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.548275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.574278 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:04:02.664710 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-21c23887-7438-4042-84c9-38636ec5e36d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 204 len: 0 microversion: 2.1 time: 0.130255 Aug 04 21:04:02.665229 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 486/944] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:02 2022] DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:02.675084 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:02.675710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:02.682181 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.682669 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.683112 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.683807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.684294 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.684792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.815728 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:02.823560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-52283610-4e37-4b71-aac5-640c0869082e tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1674 microversion: 2.1 time: 0.153827 Aug 04 21:04:02.824138 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 459/945] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:02 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:02.911140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:02.912617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:02.918590 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.919011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.919440 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:02.920120 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:02.920622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:02.921031 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:03.053970 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:03.061799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:03.063343 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:03.064513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c65eaf6a-e06e-4607-84bc-648031c7117b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.157566 Aug 04 21:04:03.065075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 487/946] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:02 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:03.845012 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:03.845624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:03.853213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:03.853700 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:03.854145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:03.854839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:03.855295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:03.855719 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:04.009013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:04.017048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aded4a07-f5b7-4f66-a7da-acecf2485a4c tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1674 microversion: 2.1 time: 0.175838 Aug 04 21:04:04.017664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 460/947] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:03 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:04.088451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:04.089089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:04.095803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:04.096213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:04.096665 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:04.097353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:04.097805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:04.098233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:04.234320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:04.245713 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:04.248230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:04.250043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-742276d3-6af8-44bf-a960-a30e7e18d5de tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.165650 Aug 04 21:04:04.250882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 488/948] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:04 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:05.039034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:05.039653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:05.045739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:05.046297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:05.046743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:05.047439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:05.047903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:05.048355 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:05.281839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:05.282450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:05.290865 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:05.294172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:05.298016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:05.298719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:05.299610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:05.300086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:05.300564 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:05.310196 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b86dcc93-d9ac-421e-855f-e6d50a662049 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1674 microversion: 2.1 time: 0.275366 Aug 04 21:04:05.311210 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 461/949] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:05 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:05.551932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "name": "network-vif-plugged", "status": "completed", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:05.563634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:05.570717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:05.571189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:05.571628 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:05.580510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:05.582010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:05.583168 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ae742a29-ab91-40d2-9667-67522ee261dd tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.305562 Aug 04 21:04:05.592626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 489/950] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:05 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:05.592842 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] Creating event network-vif-plugged:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:04:05.598799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-29989ab1-9926-4dbd-8903-5c936406f32e req-b288c6fe-3c7a-4c8a-9451-abdfa4e0bb3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050934 Aug 04 21:04:05.599773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 462/951] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:04:06.110374 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a9ce6f-9344-4132-b198-015b744b564f", "name": "network-vif-deleted", "tag": "e42bfeff-b661-4ccf-b383-fa6ded440952"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:06.124099 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:06.124614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:06.125052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:06.137339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] Creating event network-vif-deleted:e42bfeff-b661-4ccf-b383-fa6ded440952 for instance 14a9ce6f-9344-4132-b198-015b744b564f on hv-cinder-83602 Aug 04 21:04:06.142507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-f03b07bb-a760-4145-aed4-4e38969e3099 req-d4c32e22-0de4-4606-a0ba-7eae1c0d5c53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Aug 04 21:04:06.143114 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 490/952] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:04:06.334401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:06.335164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:06.343975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:06.343975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:06.343975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:06.343975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:06.344731 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:06.344731 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:06.419504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:06.428753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-efdbfb97-70ad-4dbb-9bb3-7fc31673d087 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1323 microversion: 2.1 time: 0.099044 Aug 04 21:04:06.429337 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 463/953] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:06 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:06.608309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:06.608946 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:06.616204 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:06.616731 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:06.617187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:06.617876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:06.618366 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:06.618791 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:06.770487 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:06.780073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:06.781472 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:06.782653 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-824b7a87-957f-4f50-9a85-cb384f99c884 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.179291 Aug 04 21:04:06.783207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 491/954] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:06 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:07.450068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:07.450804 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:07.457303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:07.457864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:07.458449 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:07.459160 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:07.459720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:07.460360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:07.494815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:07.495452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:07.495742 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:07.496191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lazy-loading 'fault' on Instance uuid 14a9ce6f-9344-4132-b198-015b744b564f {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:04:07.809587 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:07.811761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:07.813648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87929879b1c74efea0a390a3ce1a4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ea3d73695c4b3dba67b2da3a4df789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:07.818914 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:07.819396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:07.819838 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:07.820541 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:07.820993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:07.821278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-af0d204a-0e23-4c53-907d-5a734a030503 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 200 len: 1328 microversion: 2.1 time: 0.375068 Aug 04 21:04:07.821440 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:07.822637 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 464/955] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:07 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:07.962752 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:07.965170 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.972295 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:07.974297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:07.975533 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-940c7080-4fea-41e7-833a-a6f29810514b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1730 microversion: 2.20 time: 0.171247 Aug 04 21:04:07.976087 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 492/956] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:07 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:04:08.844260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:08.844973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:08.851180 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:08.851671 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:08.852114 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:08.852831 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:08.853298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:08.853727 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:08.867161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f HTTP/1.1 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:08.868846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:08.870521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '14a9ce6f-9344-4132-b198-015b744b564f'} Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:08.871434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:08.872997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:08.874309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:08.874309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c69b2f58-56cb-44fd-b9fe-f851612d3999 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 404 len: 111 microversion: 2.1 time: 0.030530 Aug 04 21:04:08.874309 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 465/957] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:08 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:08.879116 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b8491836-03ca-435c-8a45-8149090a071a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '.version_select at 0x7f2bda90e9d0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:08.900585 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b8491836-03ca-435c-8a45-8149090a071a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520077528" status: 202 len: 0 microversion: 2.1 time: 0.025225 Aug 04 21:04:08.901158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 493/958] 10.222.0.52 () {58 vars in 1221 bytes} [Thu Aug 4 21:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520077528 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:04:08.998903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:08.999666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:09.006314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:09.006816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:09.007258 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:09.007963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:09.008456 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:09.008884 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:09.251103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:09.260068 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:09.261609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:09.262770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7bdef43d-46d8-4a5c-a0d8-ac1ffd4ef20c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1717 microversion: 2.20 time: 0.267931 Aug 04 21:04:09.263327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 466/959] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:04:08 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1717 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:04:11.860595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:11.861219 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:11.867341 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:11.867827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:11.868266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:11.868984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:11.869439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:11.869862 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:11.883756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f HTTP/1.1 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:11.885435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.886777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '14a9ce6f-9344-4132-b198-015b744b564f'} Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:11.887555 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.889028 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.890618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:11.890618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e2320310-5b80-421a-a6e0-f4789d78acc1 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 404 len: 111 microversion: 2.1 time: 0.030617 Aug 04 21:04:11.890618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 494/960] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:11 2022] DELETE /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:11.895328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:11.896716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: 14a9ce6f-9344-4132-b198-015b744b564f] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:11.899189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=44 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.904642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:11.905116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:11.905559 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:11.906264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:11.906729 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:11.907166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:11.920792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f HTTP/1.1 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:11.922317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.924870 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '14a9ce6f-9344-4132-b198-015b744b564f'} Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:11.926520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. Aug 04 21:04:11.929730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:11.932110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance 14a9ce6f-9344-4132-b198-015b744b564f could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:11.932110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5151c8db-e3d2-43d2-a0d4-bfb72162f18d tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f" status: 404 len: 111 microversion: 2.1 time: 0.032202 Aug 04 21:04:11.932110 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 467/961] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:11 2022] GET /compute/v2.1/servers/14a9ce6f-9344-4132-b198-015b744b564f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:13.084893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:13.085464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:13.091519 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:13.091998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:13.092462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:13.093169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:13.093623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:13.094044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:13.108069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 HTTP/1.1 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:13.109708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.111448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'cd4eef31-8b60-4328-adde-046f701b8d15'} Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:13.112322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.113839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.116026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:13.116026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a4425d28-1be2-4586-9d65-e359e4f22b7a tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 404 len: 111 microversion: 2.1 time: 0.030503 Aug 04 21:04:13.116026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 495/962] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:13 2022] DELETE /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:13.121046 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:13.121685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] [instance: cd4eef31-8b60-4328-adde-046f701b8d15] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:13.128359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:13.128846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:13.129278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:13.130035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:13.130691 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:13.131115 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:13.144781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] HTTP exception thrown: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Request method failure captured: Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 HTTP/1.1 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIHp5kX2Lb6wPGINY1ge60h83d-TNZIc-i5pkvE6l0wPuerVI-QER8UFrvLB1l4nX2jBKXVlrDeS67FO48IJBMlE_9VXWCWDTE1AmyuTnnn5qTzn-6ud2ua0pSpfNelNaTWr8yv81qsMWxfYvTiSmaqFeNsruuswVP9OfiSP5YPeyA Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:13.146402 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6ea3d73695c4b3dba67b2da3a4df789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6ea3d73695c4b3dba67b2da3a4df789", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6ea3d73695c4b3dba67b2da3a4df789"}]}] Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: e6ea3d73695c4b3dba67b2da3a4df789 Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92582144 Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 87929879b1c74efea0a390a3ce1a4006 Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-92582144-project Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.148092 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'cd4eef31-8b60-4328-adde-046f701b8d15'} Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:13.149145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. Aug 04 21:04:13.150663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:13.152155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] Returning 404 to user: Instance cd4eef31-8b60-4328-adde-046f701b8d15 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:13.152155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-74d065f9-895c-45a0-bf4e-4887a193eba7 tempest-AttachVolumeTestJSON-92582144 tempest-AttachVolumeTestJSON-92582144-project] 10.222.0.52 "GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15" status: 404 len: 111 microversion: 2.1 time: 0.030838 Aug 04 21:04:13.152155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 468/963] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:13 2022] GET /compute/v2.1/servers/cd4eef31-8b60-4328-adde-046f701b8d15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:17.564060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b1c1a4b8-6cc6-4710-9655-88325320382c tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Action: 'create', calling method: .version_select at 0x7f2bda90e9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1509084401", "metadata": {"Type": "work"}}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:17.896848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b1c1a4b8-6cc6-4710-9655-88325320382c tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.496268 Aug 04 21:04:17.897950 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 496/964] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Aug 4 21:04:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 498 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 21:04:17.917638 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-af572884-d94e-4ae6-8878-c43d11a2b138 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bda18a700>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:17.975381 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-af572884-d94e-4ae6-8878-c43d11a2b138 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 200 len: 353 microversion: 2.1 time: 0.064543 Aug 04 21:04:17.976369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 469/965] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:04:17 2022] GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:18.996064 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b7126126-9e47-41d2-b13e-957115e54150 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bda801940>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:19.045898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b7126126-9e47-41d2-b13e-957115e54150 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 200 len: 354 microversion: 2.1 time: 0.054816 Aug 04 21:04:19.046461 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 497/966] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:04:18 2022] GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:19.059602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7f89f84a-5c26-43e4-b42d-ba32cd59fcb8 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bdac32e50>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:19.111246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7f89f84a-5c26-43e4-b42d-ba32cd59fcb8 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 200 len: 354 microversion: 2.1 time: 0.055397 Aug 04 21:04:19.112185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 470/967] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:04:19 2022] GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:19.129287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2b46aed6-1c61-4361-8219-190f5ff666ea tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bda7c84c0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:19.194334 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2b46aed6-1c61-4361-8219-190f5ff666ea tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 202 len: 0 microversion: 2.1 time: 0.068194 Aug 04 21:04:19.195008 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 498/968] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:04:19 2022] DELETE /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:04:19.204064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d6805b7-ffdd-43c5-842a-bf0eda09fc4f tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bda351ee0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:19.257286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d6805b7-ffdd-43c5-842a-bf0eda09fc4f tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 200 len: 353 microversion: 2.1 time: 0.057178 Aug 04 21:04:19.257867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 471/969] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:04:19 2022] GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:20.270816 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c2e30eb-18ab-48f0-be67-8897772a0e38 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Calling method '.version_select at 0x7f2bda6a3a60>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:20.300304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-5c2e30eb-18ab-48f0-be67-8897772a0e38 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] HTTP exception thrown: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c2e30eb-18ab-48f0-be67-8897772a0e38 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Request method failure captured: Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 HTTP/1.1 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DRRnS867kk8QfBOpKsDQJtHBLTQ3eXi0ONDXHDR9Dbe-nP2puzB8Vse8Eo3xjnwcihXgXtpHBEeeITK9Lo2d8SIFYigcNdangk8yd7N_GtCfYJV_EtdGKYMe7EK7yhlF2GA2m41Oauv0Z0lEmQIRLIRGRoasxkrr1csfskqt48h6gc Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 39a105e1d7c54c609b70064dcbfe04a4 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesGetTestJSON-299489495 Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:20.302285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39a105e1d7c54c609b70064dcbfe04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39a105e1d7c54c609b70064dcbfe04a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39a105e1d7c54c609b70064dcbfe04a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39a105e1d7c54c609b70064dcbfe04a4"}]}] Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesGetTestJSON-299489495 Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 39a105e1d7c54c609b70064dcbfe04a4 Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesGetTestJSON-299489495 Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesGetTestJSON-299489495-project Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 982fc634537e4ef287966fba2493ffb3 Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesGetTestJSON-299489495-project Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'b1676550-2838-4692-883e-96ac91e2c2b8'} Aug 04 21:04:20.303724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. (HTTP 404) (Request-ID: req-4c219521-4597-4700-97ce-607f9dff5aa0) Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:20.304639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:04:20.305848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:04:20.306995 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c2e30eb-18ab-48f0-be67-8897772a0e38 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] Returning 404 to user: Volume b1676550-2838-4692-883e-96ac91e2c2b8 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5c2e30eb-18ab-48f0-be67-8897772a0e38 tempest-VolumesGetTestJSON-299489495 tempest-VolumesGetTestJSON-299489495-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8" status: 404 len: 109 microversion: 2.1 time: 0.037549 Aug 04 21:04:20.308778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 499/970] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:04:20 2022] GET /compute/v2.1/os-volumes/b1676550-2838-4692-883e-96ac91e2c2b8 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:32.290777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.291892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=68 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.297509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:32.298001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:32.307532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:32.307887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:32.308578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:32.309293 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:32.309756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:32.310217 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:32.337093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-96b69b8d-be5a-4214-821e-f760542e7c8e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/ips" status: 200 len: 149 microversion: 2.1 time: 0.047825 Aug 04 21:04:32.337679 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 472/971] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:04:32 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:33.693867 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.694675 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=5 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.698894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a266670-f573-4e63-ba7a-eb0b50db02b3"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:33.701218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:33.708889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:33.709660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:33.710855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:33.710855 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:33.711236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:33.711658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:34.193405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6cb80fe5-c018-4f9d-b93d-fad2e117cb87 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "POST /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501001 Aug 04 21:04:34.193746 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 500/972] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:04:33 2022] POST /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:37.877431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-564044072", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "networks": [{"uuid": "82184ee7-4a83-4e7a-9dd6-52586936904e"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:38.096621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] validate_networks() for [('82184ee7-4a83-4e7a-9dd6-52586936904e', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:04:38.457886 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:04:38.458308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:04:38.459302 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:04:38.459705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:04:38.460117 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:04:38.469927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:38.470263 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:38.470695 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:38.471414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:38.471863 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:38.472279 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:38.489732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Getting quotas for project 29a9462a18d24287b396b06231028d3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:04:38.494014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Getting quotas for user 62e8a7e7dba64398b0f6bdbc51c1e495 and project 29a9462a18d24287b396b06231028d3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:04:38.512656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:04:38.514963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:04:38.564709 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b79c3555-1adc-4532-98a5-fae5b3593e60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691321 Aug 04 21:04:38.565623 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 473/973] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:04:38.578273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6d7ec57f-ce5b-421a-96c2-bc5d9c1b9f8c tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:38.578969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6d7ec57f-ce5b-421a-96c2-bc5d9c1b9f8c tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:38.633521 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6d7ec57f-ce5b-421a-96c2-bc5d9c1b9f8c tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:38.642992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6d7ec57f-ce5b-421a-96c2-bc5d9c1b9f8c tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1213 microversion: 2.1 time: 0.069340 Aug 04 21:04:38.647092 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 501/974] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:38 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:39.665732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:39.666511 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:39.672810 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:39.673314 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:39.674026 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:39.674899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:39.675320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:39.675636 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:39.753300 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:39.761954 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5e381ec3-72f6-41c4-a708-3c55f93bf03e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1273 microversion: 2.1 time: 0.101271 Aug 04 21:04:39.762712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 474/975] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:39 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:40.783058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:40.783668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:40.791994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:40.792508 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:40.792951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:40.793641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:40.794093 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:40.794517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:40.996662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:41.006593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-13fad119-cb3a-4852-853a-38b7fc956aee tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.227057 Aug 04 21:04:41.007268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 502/976] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:40 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:41.280248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16508bd7-1dba-4261-9a10-bb88d7f360b7", "tag": "a37b76cf-d9e2-4a47-b871-d459b587735e"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:41.292149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:41.292876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:41.293290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:41.306090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] Creating event network-changed:a37b76cf-d9e2-4a47-b871-d459b587735e for instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 on hv-cinder-83602 Aug 04 21:04:41.311313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-058a2163-9d58-4b8a-92ef-b6b5197f1d2f req-ab1793ba-0e7f-4b97-bb6a-8075880d335e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034784 Aug 04 21:04:41.312116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 475/977] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:41.887241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:41.887795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:41.894231 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:41.894720 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:41.895162 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:41.895979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:41.896480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:41.896916 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:41.980029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'services' on Instance uuid d9dc5c70-675d-4499-b815-cb8706745eca {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:04:42.027789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:42.028517 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:42.034665 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:42.035204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:42.035717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:42.036557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:42.037446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:42.038412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:42.057137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f73e1491-e229-4c00-ad90-896645f331aa tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments/6a266670-f573-4e63-ba7a-eb0b50db02b3" status: 202 len: 0 microversion: 2.1 time: 0.173797 Aug 04 21:04:42.057738 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 503/978] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:04:41 2022] DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments/6a266670-f573-4e63-ba7a-eb0b50db02b3 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:04:42.066586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:42.070443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:42.076920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:42.077406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:42.078115 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:42.079337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:42.080171 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:42.080696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:42.112963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5241eea9-276a-4c4d-89e2-ded8be21bd82 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050529 Aug 04 21:04:42.113552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 504/979] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:42 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:42.184473 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:42.189150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-96ef1d5c-dd1b-44a0-9d40-283bf20eb350 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.165503 Aug 04 21:04:42.189730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 476/980] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:42 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:43.126044 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:43.128220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:43.135303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:43.135777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:43.136205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:43.136911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:43.137365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:43.137781 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:43.166885 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-75df38c9-5124-4a25-b7f9-7d19a62ed630 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 04 21:04:43.167435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 505/981] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:43 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:04:43.211201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:43.211811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:43.218264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:43.218749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:43.219188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:43.219877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:43.220361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:43.220787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:43.354595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:43.361966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8802a16a-64c9-4c35-973d-5d4d50f6d468 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.155113 Aug 04 21:04:43.362520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 477/982] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:43 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:44.179531 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:44.182353 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:44.188909 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:44.189420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:44.189864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:44.190551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:44.191012 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:44.191441 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:44.221346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-49cd654c-652a-47cb-8220-c0979bf13786 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046517 Aug 04 21:04:44.221896 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 506/983] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:44 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:44.387106 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:44.387726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:44.394366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:44.394908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:44.395646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:44.397120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:44.397587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:44.398243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:44.547037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:44.555995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-16be3a8f-e810-415b-bee9-46c31438b1ed tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.172980 Aug 04 21:04:44.556599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 478/984] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:44 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:45.233149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:45.235359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:45.242077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.242559 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.242985 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.243666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.244121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.244563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.275428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1b85e454-ce10-48d6-8447-e83782de3d39 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046150 Aug 04 21:04:45.275987 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 507/985] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Aug 4 21:04:45 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:04:45.342927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:45.343444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:45.349859 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.350356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.350821 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.351639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.352142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.352615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.379239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:04:45.455287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cdadc851-3f60-4f00-a0ee-020e630d2019 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 204 len: 0 microversion: 2.1 time: 0.115930 Aug 04 21:04:45.455963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 479/986] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:45 2022] DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:45.465193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:45.465801 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:45.471717 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.472207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.472681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.473372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.473944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.474422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.577789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:45.578760 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:45.586122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.586639 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.587051 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.587753 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:45.588207 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:45.588658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:45.612667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:45.621429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7d4c8995-afa4-4e7b-99c6-332bb241f853 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1681 microversion: 2.1 time: 0.160201 Aug 04 21:04:45.622300 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 508/987] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:45 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:45.721881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:45.729560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9db624f4-6715-48cf-bb3b-25ae9d3384af tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.156061 Aug 04 21:04:45.730142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 480/988] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:45 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:46.643002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:46.643610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:46.650711 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:46.651196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:46.651629 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:46.652318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:46.652793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:46.653220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:46.750983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:46.751587 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:46.758658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:46.759157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:46.759598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:46.760306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:46.760788 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:46.761219 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:46.782077 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:46.790033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-72d9263d-20bd-4ce3-8e2e-b97d5f4168b7 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1681 microversion: 2.1 time: 0.150846 Aug 04 21:04:46.790688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 509/989] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:46 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:46.891703 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:46.900134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-413e009b-6aa6-406e-99d9-0421e039e70b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.153007 Aug 04 21:04:46.900739 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 481/990] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:46 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:47.738681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16508bd7-1dba-4261-9a10-bb88d7f360b7", "name": "network-vif-plugged", "status": "completed", "tag": "a37b76cf-d9e2-4a47-b871-d459b587735e"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:47.752082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:47.752618 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:47.753055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:47.765408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] Creating event network-vif-plugged:a37b76cf-d9e2-4a47-b871-d459b587735e for instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 on hv-cinder-83602 Aug 04 21:04:47.771490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-b02aa85e-3660-4ed6-9b8f-c16aa50ace56 req-c7945b21-380b-4254-a800-a4d5516c99a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038705 Aug 04 21:04:47.772622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 510/991] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:47.811758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:47.812567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:47.827109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:47.827749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:47.828571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:47.829430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:47.829956 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:47.830447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:47.921890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:47.922591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:47.930151 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:47.930644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:47.931086 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:47.931786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:47.932245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:47.932709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:48.398491 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:48.405894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c67e8f1f-ad16-4708-895b-2a30f024a122 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1681 microversion: 2.1 time: 0.598444 Aug 04 21:04:48.406641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 482/992] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:47 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1681 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:48.472200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:48.481357 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3eadce94-9905-4649-af97-c68e350cfd17 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.563446 Aug 04 21:04:48.481952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 511/993] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:47 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:48.989053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9dc5c70-675d-4499-b815-cb8706745eca", "name": "network-vif-deleted", "tag": "98c15788-6a93-46fe-87ff-c1196382389a"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:48.995107 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.995930 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.003268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.003756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.004189 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.020363 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] Creating event network-vif-deleted:98c15788-6a93-46fe-87ff-c1196382389a for instance d9dc5c70-675d-4499-b815-cb8706745eca on hv-cinder-83602 Aug 04 21:04:49.026599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e4a1500f-77e6-49c5-b4fa-8694ffcf0d70 req-176418ed-5c46-4ec3-9d7d-72e5717e3bff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041021 Aug 04 21:04:49.030044 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 483/994] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:49.296262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:49.296792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:49.299192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.306052 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.306642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.307264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.308029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.308709 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.309136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.335566 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:04:49.428717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:49.429686 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:49.430762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-127485df-6caa-49ee-b30f-d291c227a01e tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "DELETE /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 204 len: 0 microversion: 2.1 time: 0.138174 Aug 04 21:04:49.431558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 512/995] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:49 2022] DELETE /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:49.437777 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.438434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.438939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.439740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.439866 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:49.440312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.440446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:49.441014 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.448015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.448540 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.448977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.449685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.450268 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.450724 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.476468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.477120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.477660 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.478218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'fault' on Instance uuid d9dc5c70-675d-4499-b815-cb8706745eca {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:04:49.537543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:49.545440 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f093867-8158-4bd4-8f0e-7e6cbd471efe tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1331 microversion: 2.1 time: 0.121962 Aug 04 21:04:49.556535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 484/996] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:49 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:49.556535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:49.556535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:49.557442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.557908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.558354 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.559048 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:49.559503 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:49.559934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:49.665584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:49.678149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1e306e7b-9ee1-4d99-af95-9bfd29b749b4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1577 microversion: 2.1 time: 0.242015 Aug 04 21:04:49.678973 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 513/997] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:49 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:49.744653 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:49.753021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90de8292-8f2e-4d71-8875-3277bcb9d634 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1313 microversion: 2.1 time: 0.205656 Aug 04 21:04:49.753905 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 485/998] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:49 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:50.568448 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:50.569047 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:50.575439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.575911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.576426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.577126 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.577574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.577992 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.595479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.609859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.610331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.610763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.611197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'fault' on Instance uuid d9dc5c70-675d-4499-b815-cb8706745eca {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:04:50.652735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:50.660570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f112b3c5-cbf2-4bb6-a8f3-a58ec5705760 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1331 microversion: 2.1 time: 0.096031 Aug 04 21:04:50.661703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 514/999] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:50 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:50.699199 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:50.699807 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:50.706230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.706715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.707149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.707854 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.708832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.709283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.781731 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:50.782257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:50.789315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.789806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.790244 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.790945 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:50.791411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:50.791835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:50.874206 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:50.884364 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-011158c4-796a-460b-9fea-2a998c42406a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1577 microversion: 2.1 time: 0.188879 Aug 04 21:04:50.888576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 486/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:50 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:50.951122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:50.959192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e34e9864-a398-4b4b-883f-205d457435f4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1496 microversion: 2.1 time: 0.181407 Aug 04 21:04:50.959857 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 515/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:50 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1496 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:51.463364 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:51.463867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:51.470035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.470526 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.470972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.471690 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.472179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.472685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.501081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:04:51.537384 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.581479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d3452d2a-93a0-43ed-83b3-f712d2f4dcd4 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 204 len: 0 microversion: 2.1 time: 0.123127 Aug 04 21:04:51.582101 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 487/1002] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:51 2022] DELETE /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:51.591339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:51.591944 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:51.598411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.599605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.599910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.600648 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.601105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.601544 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.683824 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:51.684655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:51.697185 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.697799 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.698333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.699129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.699678 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.700856 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.735442 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.736022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.736558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.737069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lazy-loading 'fault' on Instance uuid d9dc5c70-675d-4499-b815-cb8706745eca {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:04:51.748991 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:51.758638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-65ec3504-d0c1-4728-9230-1b3d049b49cf tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1502 microversion: 2.1 time: 0.170799 Aug 04 21:04:51.759628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 516/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:51 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:51.782228 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807855d862b146bdba009626f28d8d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5932111f3384861bfc778d561980e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:51.790004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cd446850-4659-4cad-bd81-e6eac6947987 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 200 len: 1331 microversion: 2.1 time: 0.110356 Aug 04 21:04:51.790594 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 488/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:51 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:51.906308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:51.906911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:51.912942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.913419 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.913844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:51.914520 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:51.914967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:51.915388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:52.052289 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:52.060049 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-66a9f7d3-26c8-4345-a720-018b09db5672 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1577 microversion: 2.1 time: 0.157536 Aug 04 21:04:52.060655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 517/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:51 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:52.787641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:52.788193 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:52.795593 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:52.796123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:52.796630 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:52.797435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:52.797965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:52.798471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:52.812465 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:52.813463 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:52.820413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:52.820897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:52.821328 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:52.822023 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:52.822469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:52.822889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:52.839339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca HTTP/1.1 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:52.840989 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:52.842429 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'd9dc5c70-675d-4499-b815-cb8706745eca'} Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:52.843462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:52.845063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:52.846442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:52.846442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7d838a2d-da1c-4ede-adf1-868e418b2c13 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 404 len: 111 microversion: 2.1 time: 0.034016 Aug 04 21:04:52.846442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 518/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:52 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:52.851424 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c09be7ed-b56d-4d65-b235-49be57c3c082 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '.version_select at 0x7f2bdf0f0e50>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:52.871557 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c09be7ed-b56d-4d65-b235-49be57c3c082 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850460194" status: 202 len: 0 microversion: 2.1 time: 0.023840 Aug 04 21:04:52.872127 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 519/1007] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Aug 4 21:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850460194 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:04:52.946190 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:52.954434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0bcdf03-e564-49b5-be0f-231dbb01daf0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1502 microversion: 2.1 time: 0.170973 Aug 04 21:04:52.955313 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 489/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:52 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:53.082026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:53.082642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:53.090827 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:53.091319 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:53.091757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:53.092490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:53.092952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:53.093386 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:53.568683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:53.576259 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a6d4c8de-96e4-45f9-a128-ed0f40aa18ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1577 microversion: 2.1 time: 0.498121 Aug 04 21:04:53.577122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 520/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:53 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1577 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:53.943050 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16508bd7-1dba-4261-9a10-bb88d7f360b7", "name": "network-vif-deleted", "tag": "a37b76cf-d9e2-4a47-b871-d459b587735e"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:53.953888 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:53.954924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:53.955361 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:53.968167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] Creating event network-vif-deleted:a37b76cf-d9e2-4a47-b871-d459b587735e for instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 on hv-cinder-83602 Aug 04 21:04:53.974539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b112b599-49e1-4f69-911c-18ac366f3e1a req-c2be3af8-76b9-46c2-9ba3-7cbf906971c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 Aug 04 21:04:53.975327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 490/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:53.981478 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:53.983441 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:53.996965 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:53.998045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:54.001503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:54.003129 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:54.003623 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:54.004592 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:54.118679 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:54.127905 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9ea43642-b2a7-4ed8-bd51-b4e5b5fa6d1d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 200 len: 1298 microversion: 2.1 time: 0.154130 Aug 04 21:04:54.129344 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 521/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:53 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:54.466666 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d281c9-228e-4aeb-8054-fb5ac796724e", "name": "network-vif-deleted", "tag": "110bbd8a-2042-4a58-8a76-6a3ca4f3d460"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:54.504966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:54.506178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:54.507649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:54.541425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] Creating event network-vif-deleted:110bbd8a-2042-4a58-8a76-6a3ca4f3d460 for instance 46d281c9-228e-4aeb-8054-fb5ac796724e on hv-cinder-83602 Aug 04 21:04:54.546599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f13716ca-97d6-480d-add2-f5d747c85a52 req-903fdcc0-212c-4c2c-9979-669b84cf0028 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089401 Aug 04 21:04:54.547386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 491/1012] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:54.599532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:54.600829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:54.608748 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:54.609498 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:54.610263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:54.611196 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:54.611769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:54.612473 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:54.695632 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:54.704644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-31e2b444-26e9-4cfa-9ece-6db384673ed3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 200 len: 1224 microversion: 2.1 time: 0.109709 Aug 04 21:04:54.705317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 522/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:54 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:55.153744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:55.154940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: 16508bd7-1dba-4261-9a10-bb88d7f360b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:55.163633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.164271 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.164970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.166016 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.166608 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.167183 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.184644 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:55.185470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:55.208740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.209550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.210273 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.211462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.212211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.215418 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.217784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] HTTP exception thrown: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Request method failure captured: Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 HTTP/1.1 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DRkCutXiROOERDUIoH_nslJaX3h6dIJYaRsSp6hZ6TrswLnr73owQdT-kIIK0OGi0T8wutndvvCr_XlJX1tM35Up7HOVktO0gJpkmDlXOEqCl-RoBwDrjNRi8J4vbA8oUU4yu7GAnoA1SlcfucHt44fa-BxTEEk4htWRIbCuKBgze0 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 29a9462a18d24287b396b06231028d3a Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesActionsTest-461476726 Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:55.224787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29a9462a18d24287b396b06231028d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29a9462a18d24287b396b06231028d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29a9462a18d24287b396b06231028d3a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29a9462a18d24287b396b06231028d3a"}]}] Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesActionsTest-461476726 Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 29a9462a18d24287b396b06231028d3a Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesActionsTest-461476726 Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesActionsTest-461476726-project Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 62e8a7e7dba64398b0f6bdbc51c1e495 Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesActionsTest-461476726-project Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. Aug 04 21:04:55.227553 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '16508bd7-1dba-4261-9a10-bb88d7f360b7'} Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:55.229264 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. Aug 04 21:04:55.236767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.237880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Returning 404 to user: Instance 16508bd7-1dba-4261-9a10-bb88d7f360b7 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:55.237880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-17d7296a-ae97-4f6a-874d-e7028f7eb631 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7" status: 404 len: 111 microversion: 2.1 time: 0.080220 Aug 04 21:04:55.244540 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 492/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:55 2022] GET /compute/v2.1/servers/16508bd7-1dba-4261-9a10-bb88d7f360b7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:55.256611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca HTTP/1.1 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:55.258351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.261176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'd9dc5c70-675d-4499-b815-cb8706745eca'} Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:55.262805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.271308 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.274277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:55.274277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-2eff9b9f-57e5-4cdd-90e2-bd085bf759be tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 404 len: 111 microversion: 2.1 time: 0.082006 Aug 04 21:04:55.274277 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 523/1015] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:55 2022] DELETE /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:55.281270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:55.282770 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: d9dc5c70-675d-4499-b815-cb8706745eca] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:55.296496 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.297928 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.299302 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.301115 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.302647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.303715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.326527 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca HTTP/1.1 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:55.328650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.331108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'd9dc5c70-675d-4499-b815-cb8706745eca'} Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:55.331923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. Aug 04 21:04:55.333835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.335018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1892401083", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "networks": [{"uuid": "82184ee7-4a83-4e7a-9dd6-52586936904e"}]}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:55.335139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance d9dc5c70-675d-4499-b815-cb8706745eca could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:55.335754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7236ca14-fe8d-4eea-add8-77c0ab0456c0 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca" status: 404 len: 111 microversion: 2.1 time: 0.068465 Aug 04 21:04:55.336566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 493/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:55 2022] GET /compute/v2.1/servers/d9dc5c70-675d-4499-b815-cb8706745eca => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:55.445586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] validate_networks() for [('82184ee7-4a83-4e7a-9dd6-52586936904e', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:04:55.726409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:55.727382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:55.734432 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.735088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.735960 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.736287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.736846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.737429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.754684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] HTTP exception thrown: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Request method failure captured: Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e HTTP/1.1 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DOpNoS386_6DFJ1kUF5D1-U6BZ-ES-CWNMtQ1D2TMak1XNG_A-eLUvq3Tys7IcQ5Ka-ddCDOf7JE5fABE_1Qq4EV0nRaOMUZxE3bTV0aoMpql2Igmz5pbbKxY4pcN1a5_GndVn6NV3tWJL9W-HRJlcPjL6Bng4lWS1PmiOyojptpps Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:04:55.756916 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7535eb1709bc4bfe8a1e251fb0db4593", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7535eb1709bc4bfe8a1e251fb0db4593"}]}] Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-818687791 Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 3f4c9c7f2ddd4403b13696794dfaab5d Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:04:55.758386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '46d281c9-228e-4aeb-8054-fb5ac796724e'} Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:55.759216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:04:55.760500 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:04:55.761664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Returning 404 to user: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:55.761664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-30ea63ea-3115-4611-8f5c-8fbd419bf308 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 404 len: 111 microversion: 2.1 time: 0.036165 Aug 04 21:04:55.761664 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 494/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:55 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:55.875548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-191308051", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367343419", "security_groups": [{"name": "tempest-secgroup-smoke-1969714044"}], "block_device_mapping_v2": [{"uuid": "e61f1685-afc1-4d86-a798-147a052205f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28abb33f-5ab1-4183-ab52-0944bb76f54a"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:55.901071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:04:55.901780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:04:55.902503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:04:55.902889 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:04:55.903302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:04:55.913870 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.914421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.914898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.915741 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:55.916591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:55.917279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:55.939245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Getting quotas for project 29a9462a18d24287b396b06231028d3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:04:55.943875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Getting quotas for user 62e8a7e7dba64398b0f6bdbc51c1e495 and project 29a9462a18d24287b396b06231028d3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:04:55.955662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:04:55.958333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:04:56.019910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] validate_networks() for [('28abb33f-5ab1-4183-ab52-0944bb76f54a', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:04:56.022732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-88612e9a-8e31-4712-86af-9b7243721544 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699045 Aug 04 21:04:56.023563 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 524/1018] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:04:56.034237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6859683b-14ad-4e2d-9fd0-f3508f81e90f tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.034849 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6859683b-14ad-4e2d-9fd0-f3508f81e90f tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.124303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6859683b-14ad-4e2d-9fd0-f3508f81e90f tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:56.131663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6859683b-14ad-4e2d-9fd0-f3508f81e90f tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1214 microversion: 2.1 time: 0.101083 Aug 04 21:04:56.132595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 525/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:56 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:56.496898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:04:56.497722 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:04:56.497899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:04:56.498158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:04:56.498570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:04:56.508267 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.508822 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.509213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.509931 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.510387 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.510805 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.512375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.512892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.519797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.521487 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.522131 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.522860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.523336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.523801 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.532756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:04:56.542613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for user 3f4c9c7f2ddd4403b13696794dfaab5d and project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:04:56.546507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 HTTP/1.1 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:56.548452 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.550471 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '28bf7558-e193-499d-a67f-701ea32da4f0'} Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:56.551387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.553646 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.555982 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:56.556874 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fa0c3496-1e99-4fb6-bc90-19b859e72a5a tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 404 len: 111 microversion: 2.1 time: 0.048394 Aug 04 21:04:56.557891 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 526/1020] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:56 2022] DELETE /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:56.567580 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.568211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 28bf7558-e193-499d-a67f-701ea32da4f0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.574913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.575412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.575851 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.577018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.577604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.578035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.593158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 HTTP/1.1 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:56.594702 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.596469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '28bf7558-e193-499d-a67f-701ea32da4f0'} Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:56.597489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. Aug 04 21:04:56.599263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.600451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 28bf7558-e193-499d-a67f-701ea32da4f0 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:56.600451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9a94d9cb-e41d-4c1b-9628-40379c22de8d tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0" status: 404 len: 111 microversion: 2.1 time: 0.034108 Aug 04 21:04:56.600451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 527/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:56 2022] GET /compute/v2.1/servers/28bf7558-e193-499d-a67f-701ea32da4f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:56.607000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.607584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.613925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.615333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.616230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.617263 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.617872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.618420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.631385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:04:56.633584 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e61f1685-afc1-4d86-a798-147a052205f5',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:04:56.642058 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 HTTP/1.1 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:56.643624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.650500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0'} Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:56.652174 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.654305 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.657500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:56.657500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-96e04258-b9e5-4ef8-9315-0d97c907044e tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 404 len: 111 microversion: 2.1 time: 0.042588 Aug 04 21:04:56.657500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 528/1022] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:56 2022] DELETE /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:56.657500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.657500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.663413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.663893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.664511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.665261 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:56.665715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:56.666257 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:56.681171 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 HTTP/1.1 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:56.682696 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.684545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0'} Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:56.685377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. Aug 04 21:04:56.686668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:56.689078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance 0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:56.689078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0e3c0062-0e64-4338-915c-4956c397448c tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0" status: 404 len: 111 microversion: 2.1 time: 0.033322 Aug 04 21:04:56.689078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 529/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:56 2022] GET /compute/v2.1/servers/0dc4ba7a-8645-4291-b12e-aedfd0f8dbf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:56.815937 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3616b1c4-c761-444e-a114-44c024e6c0f6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.944514 Aug 04 21:04:56.817786 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 495/1024] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:04:56.828142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fc2c035c-d8e4-447b-9275-10a3b63920f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:56.832543 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fc2c035c-d8e4-447b-9275-10a3b63920f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:56.889853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fc2c035c-d8e4-447b-9275-10a3b63920f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:56.898010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fc2c035c-d8e4-447b-9275-10a3b63920f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1093 microversion: 2.1 time: 0.073779 Aug 04 21:04:56.898565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 530/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:56 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:57.156362 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:57.158406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:57.167624 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.168283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.168762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.169562 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.170124 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.171794 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.315352 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:57.324829 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6982ef3-a4a1-47d7-b325-3a7f9f23c985 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1274 microversion: 2.1 time: 0.175481 Aug 04 21:04:57.327906 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 496/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:57 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:57.884842 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:57.885445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:57.892331 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.893002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.893447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.894209 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.894669 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.895097 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.910715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 HTTP/1.1 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:57.913573 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.915141 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'ef1d56ce-6efb-434e-a0cd-ff779d42d4b1'} Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:57.915964 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.918388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.920792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:57.920792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b022990d-9053-41a1-ab9f-97a6aa08b714 tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 404 len: 111 microversion: 2.1 time: 0.034150 Aug 04 21:04:57.920792 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 531/1027] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:04:57 2022] DELETE /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:57.922609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:57.924371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:57.934418 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.937511 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:57.938137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] [instance: ef1d56ce-6efb-434e-a0cd-ff779d42d4b1] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:57.941446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.941920 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.943408 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.943978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.944430 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.950594 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.951137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.951523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.952216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:57.952802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:57.953223 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:57.975327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] HTTP exception thrown: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Request method failure captured: Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 HTTP/1.1 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIR1tgzCMLOw4Wa-dyrRU_4gT44deL3GbjEuQbc0MhCeBfq-MsE5oWNG869KhKYx84kmIHekcPbS2UKzPcUzJsoOr2wems19jQddHaFyr03ZzY_oJ3vBVq9RInONEA2A4JHCQ9y5AU9vHo_SEsxGWuqnBzUe6rvBlSXdNZYcAPzR9o Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:04:57.977489 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5932111f3384861bfc778d561980e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5932111f3384861bfc778d561980e60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5932111f3384861bfc778d561980e60"}]}] Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: a5932111f3384861bfc778d561980e60 Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1025900351 Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 807855d862b146bdba009626f28d8d2f Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeNegativeTest-1025900351-project Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.978881 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'ef1d56ce-6efb-434e-a0cd-ff779d42d4b1'} Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:04:57.979638 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. Aug 04 21:04:57.981770 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:04:57.985217 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] Returning 404 to user: Instance ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:04:57.988363 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cb5bdda8-14fa-4542-918b-18c63e00c7ff tempest-AttachVolumeNegativeTest-1025900351 tempest-AttachVolumeNegativeTest-1025900351-project] 10.222.0.52 "GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1" status: 404 len: 111 microversion: 2.1 time: 0.057736 Aug 04 21:04:57.988363 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 532/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:57 2022] GET /compute/v2.1/servers/ef1d56ce-6efb-434e-a0cd-ff779d42d4b1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:04:58.051740 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:58.061958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e7f015f4-f308-4072-8169-2f43ef719301 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1191 microversion: 2.1 time: 0.146293 Aug 04 21:04:58.063850 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 497/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:57 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:58.348887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:58.350195 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:58.357156 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:58.357819 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:58.358539 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:58.360303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:58.360902 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:58.362085 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:58.884934 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:58.895933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-885000f7-fe2c-47f2-9606-0b7950a7aa27 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.550834 Aug 04 21:04:58.897021 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 533/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:58 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:59.091027 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:59.094123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:59.102329 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.113246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:59.115371 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:59.116543 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:59.118319 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:59.119450 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:59.120537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:59.266556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:04:59.284889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bb615e0a-4e8a-4315-870d-6f88055353a5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1197 microversion: 2.1 time: 0.201792 Aug 04 21:04:59.285833 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 498/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:59 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:59.402304 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4487d3a-b03f-42cc-b14d-ca37d8a69f25", "tag": "d77b1a18-3d64-44c9-ac5f-26025263960f"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:04:59.415002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.418807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:59.419532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:59.419960 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:59.435918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] Creating event network-changed:d77b1a18-3d64-44c9-ac5f-26025263960f for instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 on hv-cinder-83602 Aug 04 21:04:59.443146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-80af26e2-331a-4f80-83a0-a065d8a6e73b req-2b1e846f-20c6-4cf9-8b53-750c8c480804 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045904 Aug 04 21:04:59.444449 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 534/1032] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:04:59.964521 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:04:59.966218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:04:59.979789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:59.984032 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:59.984568 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:04:59.985312 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:04:59.985792 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:04:59.988721 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:00.173270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:00.181899 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-06c83a85-a87e-4b61-9d8e-0b06c94066a0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.264950 Aug 04 21:05:00.182494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 499/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:04:59 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:00.311416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:00.312122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:00.319144 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:00.319546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:00.319977 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:00.320738 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:00.321180 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:00.321599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:00.466593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:00.476145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d3b14840-0b03-406d-b51a-622e099dad97 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.170540 Aug 04 21:05:00.476762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 535/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:00 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:00.978045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9653f7b5-c1c6-4682-aa34-1ed163fe7bb9", "tag": "15a3f91d-55f2-4699-9db5-0904c7ab1b1d"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:00.990033 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:00.990882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:00.991535 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:01.005416 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] Creating event network-changed:15a3f91d-55f2-4699-9db5-0904c7ab1b1d for instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 on hv-cinder-83602 Aug 04 21:05:01.012054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-c8ddd670-93b3-43b9-9f2a-b5940e698af5 req-9fca1f4d-278d-4b02-9e55-9cece8e7482a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038565 Aug 04 21:05:01.012972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 500/1035] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:01.203327 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:01.204197 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:01.211232 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:01.211884 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:01.212446 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:01.213251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:01.213844 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:01.214365 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:01.426858 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:01.434852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-72547f75-052c-4fc6-8765-fb8bba6f04e3 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.235324 Aug 04 21:05:01.435568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 536/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:01 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:01.499188 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:01.499895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:01.508230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:01.508758 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:01.509195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:01.509895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:01.510354 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:01.510984 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:01.733717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:01.742550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-609fe2a3-ef5a-4f27-9ad4-a303cdc402fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.247577 Aug 04 21:05:01.743066 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 501/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:01 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:02.457041 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:02.458483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:02.465880 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:02.466598 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:02.467139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:02.468117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:02.469786 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:02.470445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:02.753833 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:02.768306 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:02.769631 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:02.769820 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a10a8324-169a-4621-aaef-de110233e806 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.316388 Aug 04 21:05:02.771215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 537/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:02 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:05:02.787940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:02.788772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:02.789871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:02.790791 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:02.791712 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:02.792317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:03.065429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:03.074951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a21353d9-143f-4b2f-b9f6-734677cea14a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.313220 Aug 04 21:05:03.088862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 502/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:02 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:05:03.791765 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:03.793671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:03.801795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:03.802491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:03.803290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:03.804010 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:03.805011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:03.805011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:03.964700 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:03.972604 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-62b1afcd-09c2-4c82-8dba-a436569def60 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.184824 Aug 04 21:05:03.973201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 538/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:03 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:05:04.098715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:04.099478 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:04.108039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:04.108765 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:04.109385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:04.110980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:04.111632 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:04.112268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:04.271659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:04.284787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bffa8c95-9d82-497b-889d-6ef6e272a354 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.189873 Aug 04 21:05:04.286297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 503/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:04 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:04.994649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:04.995847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:05.005038 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.005888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.006743 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.007933 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.008683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.009377 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.155378 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:05.164414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-63956b0d-8638-48d1-891a-b99bf24fbc3b tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.174914 Aug 04 21:05:05.165256 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 539/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:04 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:05.312940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:05.314142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:05.324532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.325481 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.326280 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.327615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.328494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.329536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.481853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:05.490385 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-071c9034-08f1-4bfe-a4d6-81f34188db76 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.186016 Aug 04 21:05:05.490976 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 504/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:05 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:05.866574 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4487d3a-b03f-42cc-b14d-ca37d8a69f25", "name": "network-vif-plugged", "status": "completed", "tag": "d77b1a18-3d64-44c9-ac5f-26025263960f"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:05.881962 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.882796 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.883333 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.900069 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] Creating event network-vif-plugged:d77b1a18-3d64-44c9-ac5f-26025263960f for instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 on hv-cinder-83602 Aug 04 21:05:05.908453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-92e9f0a8-be1b-4f51-abc6-736589b5e364 req-9169eb8b-8a15-4037-9f40-2d75a671a38d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046918 Aug 04 21:05:05.909835 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 540/1044] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:05.972903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:05.975414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:05.982634 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.982973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.983773 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:05.984134 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:05.988164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:05.988164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.022270 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-55fe0d04-ea9d-424b-a9d8-2a2ea26f7d88 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054231 Aug 04 21:05:06.022857 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 505/1045] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Aug 4 21:05:05 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:06.104063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.109735 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:06.110315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:06.117701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.118186 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.118744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.119481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.119956 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.120408 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.125398 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=100 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.152998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:05:06.187251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:06.189079 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:06.196616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.197344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.197883 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.198694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.199192 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.199840 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.260862 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a520cc90-b053-425e-8ded-f238520a74d3 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 204 len: 0 microversion: 2.20 time: 0.157767 Aug 04 21:05:06.262413 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 541/1046] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Aug 4 21:05:06 2022] DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:05:06.272104 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:06.272924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:06.278952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.279444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.279882 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.280619 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.281073 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.281497 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.391339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:06.404089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2cfe04b0-af9d-4698-97f6-8107d0810a98 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.220381 Aug 04 21:05:06.405094 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 506/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:06 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:06.455655 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:06.465671 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:06.467185 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:06.468628 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d5353d82-f9c2-4068-a7b7-848520f85e9e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.201408 Aug 04 21:05:06.469201 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 542/1048] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:06 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:06.511981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:06.512772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:06.522163 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.522843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.523278 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.524010 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:06.524510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:06.524944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:06.525523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.561814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.697316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:06.705218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-02389f11-70a0-4db9-86a4-088fc25f23ab tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.197705 Aug 04 21:05:06.705924 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 507/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:06 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:07.430888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:07.431502 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:07.433515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=10 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.440060 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.440586 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.441030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.441769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.442497 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.442930 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.495524 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:07.496939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:07.503166 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.503668 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.504108 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.504878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.505434 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.505871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.510366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.622450 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:07.630117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fabb937c-4a9e-4940-91c9-377647eac91d tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.203194 Aug 04 21:05:07.630705 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 543/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:07 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:07.668620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:07.676940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:07.678389 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:07.679563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-107fe70a-4f9f-4aaf-93c8-d0c1969a9271 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.189182 Aug 04 21:05:07.680135 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 508/1051] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:07 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:07.727712 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:07.728309 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:07.734224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.734701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.735136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.735818 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:07.736267 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:07.736714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:07.871280 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:07.879997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-57a858fc-4957-4c1a-9f25-4624299e97ba tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.156308 Aug 04 21:05:07.881579 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 544/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:07 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:08.651780 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:08.652436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:08.658867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.659345 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.659778 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:08.661081 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.661609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.662246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:08.702479 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:08.703150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:08.709877 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.710359 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.710789 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:08.711475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.711925 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.712358 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:08.845469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:08.853539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc5c4a78-7c05-426b-96d9-4d594452f64e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.205660 Aug 04 21:05:08.854122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 509/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:08 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:05:08.875412 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:08.883869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:08.885460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:08.886699 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-550572ba-d0b7-4cdb-b7d4-93ce9adaaa1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.188291 Aug 04 21:05:08.887254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 545/1054] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:08 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:08.901123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:08.901762 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:08.907765 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.908243 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.908708 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:08.909412 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:08.909861 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:08.910281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:09.042741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:09.050895 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-47c0ccb4-5cc0-4ee3-bfbb-e6a8fa9509a3 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.153698 Aug 04 21:05:09.051575 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 510/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:08 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:09.874825 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:09.875435 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:09.882437 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:09.882913 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:09.883344 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:09.884022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:09.884507 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:09.884928 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:09.911880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:09.912479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:09.918848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:09.919344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:09.919787 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:09.920541 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:09.921005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:09.921437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:10.065470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:10.073548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-6022b3ed-177d-48fc-a5d8-69100fc341a6 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.202579 Aug 04 21:05:10.074368 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 546/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:09 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:10.078888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:10.079707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:10.086599 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:10.087191 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:10.087714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:10.088538 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:10.088993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:10.089420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:10.099452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:10.107531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:10.109172 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:10.110441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a135990c-cb80-41a0-8c22-1ea5bda58d44 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.203475 Aug 04 21:05:10.111086 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 511/1057] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:09 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:10.486780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:10.494768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f0b2dd0f-1d99-4212-be2a-3ac12caadd1c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.419443 Aug 04 21:05:10.495329 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 547/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:10 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:11.095006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:11.095619 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:11.102165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.102652 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.103097 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.103793 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.104256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.104710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.134733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:11.135351 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:11.142035 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.142532 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.142975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.143719 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.144189 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.144697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.282995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:11.290550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4d623dbb-dda6-4dd7-aa30-b6d6e0da4435 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.199354 Aug 04 21:05:11.291136 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 512/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:11 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:11.313556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:11.322955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:11.324641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:11.326030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-09695717-ccba-4e70-b287-7e6168cd344b tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.195415 Aug 04 21:05:11.326692 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 548/1060] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:11 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:11.516477 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:11.517089 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:11.523995 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.524532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.524979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.525684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:11.526143 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:11.526570 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:11.659423 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:11.668358 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1285d414-367d-4960-9c14-c9914ad80448 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.155753 Aug 04 21:05:11.668951 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 513/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:11 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:12.312034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:12.312715 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:12.319983 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.320494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.320927 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.321607 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.322055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.322477 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.349948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:12.351176 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:12.357725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.358218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.358658 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.359549 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.360182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.360643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.513831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:12.523658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-46b63df9-a13c-4717-8431-71622c197bcb tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1314 microversion: 2.1 time: 0.215315 Aug 04 21:05:12.524600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 549/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:12 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:12.542748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:12.552317 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:12.553872 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:12.555056 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62be9f77-e479-44d6-8f48-ea296effe141 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1723 microversion: 2.20 time: 0.209652 Aug 04 21:05:12.555629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 514/1063] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:12 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:12.690252 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:12.690863 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:12.697667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.698163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.698605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.699367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:12.700015 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:12.700523 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:12.938624 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:12.947733 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b09855c5-07c2-4188-a7ab-dd742b4edf98 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.261292 Aug 04 21:05:12.948319 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 550/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:12 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:13.468912 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e55b14-4611-4cd7-902c-53f57144a536", "name": "network-vif-deleted", "tag": "af83c994-d4ac-4a82-aa83-3985822ad9c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:13.479076 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.479647 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.480164 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.492161 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] Creating event network-vif-deleted:af83c994-d4ac-4a82-aa83-3985822ad9c1 for instance 69e55b14-4611-4cd7-902c-53f57144a536 on hv-cinder-83602 Aug 04 21:05:13.497748 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ada3a180-abad-4396-93d0-2a84d188f488 req-02bf9140-2b48-4f6a-a203-0b95f00e96a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Aug 04 21:05:13.498534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 515/1065] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:13.546692 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:13.547297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:13.555084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.555641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.555983 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.556703 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.557152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.557570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.580304 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:13.581179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:13.588522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.589165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.589612 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.590322 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.590911 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.591349 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.674779 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:13.692325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:13.695827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1930e444b5b47ea8e606c7ee4da600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c791c03c7d7b40fcb2e0ffad05d78172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:13.698981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-81e54669-7723-4082-a4ea-4f3acb584d1c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 200 len: 1655 microversion: 2.20 time: 0.122853 Aug 04 21:05:13.705728 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 516/1066] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:13 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 1655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:05:13.755716 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:13.764303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5d2db33f-5d7d-4234-aceb-70cb6f8864aa tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1497 microversion: 2.1 time: 0.221388 Aug 04 21:05:13.764726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 551/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:13 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:13.971966 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:13.972685 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:13.981055 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.982611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.983277 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:13.984230 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:13.984953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:13.985590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.181244 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:14.194814 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fbf6b9d1-5b92-469e-a040-ff47e197db73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.227693 Aug 04 21:05:14.195514 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 517/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:13 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:14.468454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:14.468997 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:14.475951 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.476582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.477036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.477807 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.478306 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.478823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.506350 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:05:14.591543 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c599a90b-8ac6-4fff-8278-b40b28891b1e tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 204 len: 0 microversion: 2.1 time: 0.126574 Aug 04 21:05:14.595756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 552/1069] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:05:14 2022] DELETE /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:14.602633 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:14.603368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:14.610381 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.610871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.611305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.611997 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.612537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.612963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.724160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:14.724869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:14.731150 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.731626 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.732054 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.732768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:14.733215 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:14.733634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:14.747841 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 HTTP/1.1 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:05:14.749522 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:14.751236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '69e55b14-4611-4cd7-902c-53f57144a536'} Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:14.752018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:14.753318 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:14.755264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:14.755264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3ea60387-84a4-437a-acc9-63e6024a4626 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 404 len: 111 microversion: 2.20 time: 0.031573 Aug 04 21:05:14.755264 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 553/1070] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:14 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 21:05:14.756261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:14.759734 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0428ef3e-a659-4ab3-9fd8-ebeca0a2da54 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '.version_select at 0x7f2bda7f05e0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:14.763881 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b23b8dca-69f9-4971-a173-a123e64e0751 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1503 microversion: 2.1 time: 0.166585 Aug 04 21:05:14.765538 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 518/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:14 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:14.778324 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0428ef3e-a659-4ab3-9fd8-ebeca0a2da54 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182737540" status: 204 len: 0 microversion: 2.20 time: 0.022210 Aug 04 21:05:14.778929 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 554/1072] 10.222.0.52 () {60 vars in 1262 bytes} [Thu Aug 4 21:05:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182737540 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 21:05:15.216898 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:15.217425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:15.224366 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:15.224849 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:15.225287 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:15.225993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:15.226443 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:15.226866 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:15.372816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:15.381706 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-276238ac-9003-4885-bbfc-034542bef1a6 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.168818 Aug 04 21:05:15.395903 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 519/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:15 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:15.786546 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:15.787815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:15.795670 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:15.796537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:15.797140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:15.798042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:15.798767 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:15.799354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:15.939117 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:15.947976 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-56fbcaee-d718-4c62-84c3-48d8b239c14a tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1503 microversion: 2.1 time: 0.165749 Aug 04 21:05:15.948582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 555/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:15 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:16.403169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:16.403756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:16.410215 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.411439 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.412015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.412744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.413201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.413811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.554368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:16.561839 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b24cc69b-a7e5-4719-b404-378678ce63ec tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.162539 Aug 04 21:05:16.562415 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 520/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:16 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:16.861864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:16.862549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:16.869953 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.870817 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.871355 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.872297 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.872940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.873542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.877966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.889898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 HTTP/1.1 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:05:16.891597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.893251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '69e55b14-4611-4cd7-902c-53f57144a536'} Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:16.894161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.896218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.898483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:16.899354 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-20d14786-f463-49c0-8f49-44ae141622c6 tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 404 len: 111 microversion: 2.20 time: 0.041799 Aug 04 21:05:16.900036 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 556/1076] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Aug 4 21:05:16 2022] DELETE /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 21:05:16.908599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:16.909563 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: 69e55b14-4611-4cd7-902c-53f57144a536] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:16.916259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.917077 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.917614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.918558 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.919255 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.919757 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.935401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 HTTP/1.1 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:05:16.936179 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.937957 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '69e55b14-4611-4cd7-902c-53f57144a536'} Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:16.938894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. Aug 04 21:05:16.940446 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:16.942800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance 69e55b14-4611-4cd7-902c-53f57144a536 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:16.942800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d34e7e2b-28ba-4873-8cfb-793ab8141a7e tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536" status: 404 len: 111 microversion: 2.20 time: 0.033795 Aug 04 21:05:16.942800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 521/1077] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:16 2022] GET /compute/v2.1/servers/69e55b14-4611-4cd7-902c-53f57144a536 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:05:16.975950 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:16.976761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:16.985549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.985549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.991822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:16.992887 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:16.993672 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:16.994128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:17.270897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e8a7e7dba64398b0f6bdbc51c1e495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a9462a18d24287b396b06231028d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:17.282142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4487d3a-b03f-42cc-b14d-ca37d8a69f25", "name": "network-vif-deleted", "tag": "d77b1a18-3d64-44c9-ac5f-26025263960f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:17.294373 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:17.294589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:17.294861 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:17.308661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] Creating event network-vif-deleted:d77b1a18-3d64-44c9-ac5f-26025263960f for instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 on hv-cinder-83602 Aug 04 21:05:17.314039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-eb3c7fff-db5d-4566-8412-e0c6990e9be0 req-b51379cd-496b-4316-891d-77f039abc245 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035708 Aug 04 21:05:17.314707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 522/1078] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:05:17.320454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1c2dc55e-f313-4213-b827-9d5aad3986d0 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 200 len: 1503 microversion: 2.1 time: 0.353148 Aug 04 21:05:17.322794 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 557/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:16 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:17.584528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:17.585261 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:17.592075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:17.592725 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:17.593239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:17.594028 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:17.594502 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:17.594949 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:17.746265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:17.759601 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-77135d0b-f4fb-4ca8-ab43-af4f5e20d33f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.180022 Aug 04 21:05:17.760378 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 523/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:17 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:17.920942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9653f7b5-c1c6-4682-aa34-1ed163fe7bb9", "name": "network-vif-plugged", "status": "completed", "tag": "15a3f91d-55f2-4699-9db5-0904c7ab1b1d"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:17.933504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:17.933994 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:17.934678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:17.947681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] Creating event network-vif-plugged:15a3f91d-55f2-4699-9db5-0904c7ab1b1d for instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 on hv-cinder-83602 Aug 04 21:05:17.953233 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-9add2517-5219-451a-9669-5e82b44e145e req-ec05c9d6-84c0-4581-9bef-dab86742df0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036354 Aug 04 21:05:17.953691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 558/1081] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:18.105268 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:18.105862 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:18.121213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.121965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.122611 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.123487 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.124116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.124744 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.150186 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c HTTP/1.1 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:05:18.151897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.153625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'f9ada2ad-514c-4711-b112-c18aeee76d7c'} Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:18.154536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.156041 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.158123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:18.159026 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9591970e-5ca7-4c4e-bbbc-d3e31669281c tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 404 len: 111 microversion: 2.20 time: 0.057860 Aug 04 21:05:18.159590 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 524/1082] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Aug 4 21:05:18 2022] DELETE /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:05:18.168678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:18.169372 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] [instance: f9ada2ad-514c-4711-b112-c18aeee76d7c] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:18.176394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.177469 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.177612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.178253 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.178707 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.179127 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.193803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] HTTP exception thrown: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Request method failure captured: Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c HTTP/1.1 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DIPI_wZzEVpT4a-OHX3CPFvHZbTf0kEx9gOW-ICN1gPrJXkYTY1l_QY2Pd8udk4xAMPGXMW_EtAMvlpPcFd0wU8WwEY3xUlcpZjOiv_vUpRr_awvKn8FnzrKopveWCkdDWYel_a_lZgY2wCyHmKYlSn4IuhO10YiQiBIBj0a1fP2jE Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:05:18.196392 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c791c03c7d7b40fcb2e0ffad05d78172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c791c03c7d7b40fcb2e0ffad05d78172", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c791c03c7d7b40fcb2e0ffad05d78172"}]}] Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: c791c03c7d7b40fcb2e0ffad05d78172 Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1890622123 Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: a1930e444b5b47ea8e606c7ee4da600f Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1890622123-project Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.197971 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': 'f9ada2ad-514c-4711-b112-c18aeee76d7c'} Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:18.198730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. Aug 04 21:05:18.199949 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.202653 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] Returning 404 to user: Instance f9ada2ad-514c-4711-b112-c18aeee76d7c could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:18.203920 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a2a3b75e-b4f4-4e83-adbc-ba38cdc33c6d tempest-AttachVolumeShelveTestJSON-1890622123 tempest-AttachVolumeShelveTestJSON-1890622123-project] 10.222.0.52 "GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c" status: 404 len: 111 microversion: 2.20 time: 0.039593 Aug 04 21:05:18.208583 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 559/1083] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Aug 4 21:05:18 2022] GET /compute/v2.1/servers/f9ada2ad-514c-4711-b112-c18aeee76d7c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:05:18.348746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:18.350149 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] [instance: e4487d3a-b03f-42cc-b14d-ca37d8a69f25] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:18.358315 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.358823 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.359297 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.360772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.361382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.361820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.376781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] HTTP exception thrown: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Request method failure captured: Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 HTTP/1.1 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DRkCutXiROOERDUIoH_nslJaX3h6dIJYaRsSp6hZ6TrswLnr73owQdT-kIIK0OGi0T8wutndvvCr_XlJX1tM35Up7HOVktO0gJpkmDlXOEqCl-RoBwDrjNRi8J4vbA8oUU4yu7GAnoA1SlcfucHt44fa-BxTEEk4htWRIbCuKBgze0 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 29a9462a18d24287b396b06231028d3a Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesActionsTest-461476726 Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:05:18.378339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29a9462a18d24287b396b06231028d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/29a9462a18d24287b396b06231028d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_29a9462a18d24287b396b06231028d3a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/29a9462a18d24287b396b06231028d3a"}]}] Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesActionsTest-461476726 Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 29a9462a18d24287b396b06231028d3a Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesActionsTest-461476726 Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesActionsTest-461476726-project Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 62e8a7e7dba64398b0f6bdbc51c1e495 Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesActionsTest-461476726-project Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. Aug 04 21:05:18.381035 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e4487d3a-b03f-42cc-b14d-ca37d8a69f25'} Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:18.381813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. Aug 04 21:05:18.383090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:18.384323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] Returning 404 to user: Instance e4487d3a-b03f-42cc-b14d-ca37d8a69f25 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:18.384323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85230ce0-0273-4ac7-b4f0-f8a1c9929593 tempest-VolumesActionsTest-461476726 tempest-VolumesActionsTest-461476726-project] 10.222.0.52 "GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25" status: 404 len: 111 microversion: 2.1 time: 0.037199 Aug 04 21:05:18.384323 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 525/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:18 2022] GET /compute/v2.1/servers/e4487d3a-b03f-42cc-b14d-ca37d8a69f25 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:05:18.784640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:18.787149 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:18.794963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.796321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.797082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.798812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:18.799475 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:18.800254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:18.969195 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:18.978205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-b6745de8-d1aa-4283-9c53-8f3b8dd71b64 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.199787 Aug 04 21:05:18.978779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 560/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:18 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:19.999874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:20.001327 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:20.008468 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:20.008965 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:20.009408 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:20.010113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:20.010564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:20.011210 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:20.183359 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:20.196325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ebabaa2b-23bb-40b9-8878-6c16c775822c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.199927 Aug 04 21:05:20.197844 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 526/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:19 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:21.218022 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:21.218639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:21.225814 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:21.226302 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:21.226778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:21.227480 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:21.227941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:21.228394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:21.463698 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:21.471250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d9ed7e99-a9a8-495c-bff8-4e5d1356a2a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.257121 Aug 04 21:05:21.471806 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 561/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:21 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:22.491260 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:22.498517 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:22.505488 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:22.505988 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:22.506437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:22.507239 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:22.507589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:22.508017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:22.651743 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:22.660241 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec34b0e6-57ac-496a-9965-41980aec9a73 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1265 microversion: 2.1 time: 0.173184 Aug 04 21:05:22.660922 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 527/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:22 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:23.068192 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8a669b69-e7fe-4e38-989f-9261b7299166 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Action: 'create', calling method: .version_select at 0x7f2bda71be50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1878935010"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:23.370011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8a669b69-e7fe-4e38-989f-9261b7299166 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.416652 Aug 04 21:05:23.370809 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 562/1089] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Aug 4 21:05:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 418 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 21:05:23.384090 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f3d62b53-3fec-4d42-a0c1-0eaf67ca9654 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda18a3a0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:23.439672 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f3d62b53-3fec-4d42-a0c1-0eaf67ca9654 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 200 len: 345 microversion: 2.1 time: 0.060513 Aug 04 21:05:23.440289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 528/1090] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:23 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:23.681616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:23.682236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:23.689402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:23.689893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:23.690336 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:23.691030 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:23.692081 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:23.692545 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:23.823658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:23.831165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cb8f714a-7db4-41cc-8bdc-2c908d5ed487 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1453 microversion: 2.1 time: 0.153578 Aug 04 21:05:23.831721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 563/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:23 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:23.852550 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:23.853153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:23.859058 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:23.859539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:23.859973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:23.860684 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:23.861138 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:23.861559 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:23.866240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:23.998011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:24.007307 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80593a0b-0212-435c-8a3e-5cad51f2e214 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1453 microversion: 2.1 time: 0.159326 Aug 04 21:05:24.007882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 529/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:23 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:24.454082 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8cc0d4cf-69e3-4561-8c7e-8c5684ed25bc tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda71bca0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:24.505695 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8cc0d4cf-69e3-4561-8c7e-8c5684ed25bc tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 200 len: 345 microversion: 2.1 time: 0.055266 Aug 04 21:05:24.506319 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 564/1093] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:24 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:25.522248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-28f67c46-2039-4c5a-b500-1d2c4ee2d54a tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9e813a0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:25.585507 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-28f67c46-2039-4c5a-b500-1d2c4ee2d54a tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 200 len: 346 microversion: 2.1 time: 0.068985 Aug 04 21:05:25.586747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 530/1094] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:25 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:25.603864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-20f4d829-aaba-4057-b164-afa746328938 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Action: 'create', calling method: .version_select at 0x7f2bda8ada60>, body: {"snapshot": {"volume_id": "5322b17b-2d49-4b29-a874-542321f0de1c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1002967897"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:25.829660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-20f4d829-aaba-4057-b164-afa746328938 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.233266 Aug 04 21:05:25.834570 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 565/1095] 10.222.0.52 () {60 vars in 1162 bytes} [Thu Aug 4 21:05:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:25.845437 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7457901-4fa9-4ac3-8da0-e9a23f9ea166 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda19dca0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:25.887254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e7457901-4fa9-4ac3-8da0-e9a23f9ea166 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.045517 Aug 04 21:05:25.888073 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 531/1096] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:25 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:25.899701 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c85e3bb-d18b-4d43-a3da-2f02c286085d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda997700>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:25.937033 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5c85e3bb-d18b-4d43-a3da-2f02c286085d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041444 Aug 04 21:05:25.937606 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 566/1097] 10.222.0.52 () {58 vars in 1140 bytes} [Thu Aug 4 21:05:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:25.949292 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ab410665-33a7-44ed-90f9-4c00b0caf632 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9d6f040>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:25.982205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ab410665-33a7-44ed-90f9-4c00b0caf632 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.036596 Aug 04 21:05:25.982979 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 532/1098] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:25 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:26.103612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9653f7b5-c1c6-4682-aa34-1ed163fe7bb9", "tag": "15a3f91d-55f2-4699-9db5-0904c7ab1b1d"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:26.120658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:26.121420 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:26.121890 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:26.134178 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] Creating event network-changed:15a3f91d-55f2-4699-9db5-0904c7ab1b1d for instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 on hv-cinder-83602 Aug 04 21:05:26.139918 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-6946d58a-5719-41b0-aac0-5c03cd8b246b req-b7087659-e13b-4e96-8797-1036baca08d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040340 Aug 04 21:05:26.140830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 567/1099] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:05:26.996614 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-16b386a9-6566-41a7-bb3b-537c6b324402 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda18a310>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:27.039681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-16b386a9-6566-41a7-bb3b-537c6b324402 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.047613 Aug 04 21:05:27.047360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 533/1100] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:26 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:28.058098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c788bc5e-2b5a-4551-887f-b8384a95508c tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bdf0f0940>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:28.092229 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c788bc5e-2b5a-4551-887f-b8384a95508c tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.039959 Aug 04 21:05:28.093091 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 568/1101] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:28 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:29.107007 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f9651d87-40ef-4bbe-a39b-533a4903ce6b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda06e310>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:29.144513 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f9651d87-40ef-4bbe-a39b-533a4903ce6b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.041846 Aug 04 21:05:29.145597 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 534/1102] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:29 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:05:30.157653 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8413a6b2-f6f4-4daf-b2fc-e24e51691f45 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda90e280>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:30.193066 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8413a6b2-f6f4-4daf-b2fc-e24e51691f45 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.039070 Aug 04 21:05:30.194167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 569/1103] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:30 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:31.206490 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f2a8ede-06ae-492a-8425-1fdec7302d5b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bdac38160>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:31.244715 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f2a8ede-06ae-492a-8425-1fdec7302d5b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.042440 Aug 04 21:05:31.245409 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 535/1104] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:31 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:32.257611 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5fad8785-8f0e-4f70-b331-1cf8afce4945 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda8ad550>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:32.301106 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5fad8785-8f0e-4f70-b331-1cf8afce4945 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.047437 Aug 04 21:05:32.302016 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 570/1105] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:32 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:33.314646 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e81029ea-4dd7-48f6-9d5e-ef0db186b117 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9d6f160>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:33.346281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e81029ea-4dd7-48f6-9d5e-ef0db186b117 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.036031 Aug 04 21:05:33.347011 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 536/1106] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:33 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:34.359499 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-815c9378-031f-4ee4-927f-3d56b240aea5 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda71be50>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:34.413259 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-815c9378-031f-4ee4-927f-3d56b240aea5 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 288 microversion: 2.1 time: 0.057970 Aug 04 21:05:34.413836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 571/1107] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:34 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:05:34.422827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=60 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.423845 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.429510 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eeb99a2c-672c-417c-b4aa-fbd7a7a02d07 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda18a430>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:34.508641 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eeb99a2c-672c-417c-b4aa-fbd7a7a02d07 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 202 len: 0 microversion: 2.1 time: 0.086370 Aug 04 21:05:34.509505 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 537/1108] 10.222.0.52 () {58 vars in 1254 bytes} [Thu Aug 4 21:05:34 2022] DELETE /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:05:34.518826 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8bb51a73-c6e0-4810-a8fb-d8fd95fd2b92 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda90e3a0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:34.552775 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8bb51a73-c6e0-4810-a8fb-d8fd95fd2b92 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.037614 Aug 04 21:05:34.553349 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 572/1109] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:34 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:35.565908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d739fa42-a40f-40fe-ae10-11167c92c56b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9e62430>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:35.597093 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d739fa42-a40f-40fe-ae10-11167c92c56b tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.035513 Aug 04 21:05:35.597707 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 538/1110] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:35 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:36.607447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:36.608283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=30 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:36.612915 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-405f7b5c-d2bd-41be-8645-b384f285420c tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda8928b0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:36.649821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-405f7b5c-d2bd-41be-8645-b384f285420c tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.043654 Aug 04 21:05:36.650396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 573/1111] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:36 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:37.664598 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25018957-3191-4cae-99ba-df6f81609707 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9e79040>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:37.698952 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-25018957-3191-4cae-99ba-df6f81609707 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.040501 Aug 04 21:05:37.699532 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 539/1112] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:37 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:38.718924 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-11647368-8222-4e8f-8150-862ef802c4e9 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda770af0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:38.756952 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-11647368-8222-4e8f-8150-862ef802c4e9 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 200 len: 287 microversion: 2.1 time: 0.042825 Aug 04 21:05:38.757610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 574/1113] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:38 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:39.770970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c726412a-c2d8-490b-8c70-08073bad3af3 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9d6fa60>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:39.800065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-c726412a-c2d8-490b-8c70-08073bad3af3 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] HTTP exception thrown: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c726412a-c2d8-490b-8c70-08073bad3af3 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Request method failure captured: Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 HTTP/1.1 Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DSSkNLuaVpJAmK1EMNAKQ6Pfzo8mSNfRGxttZh6TCX5Yogjdk3OEyaX9Prp7KskYcN6sG1nvw5IlU95tTU1n4JDXE0Qv7H95mbpz-tWQFEjJVzfIynkhb-nfK6uTsT9jRpqD1k0fH5o0NgkBbELP1oedQij3mjdkbKtmzNk7gKtzFc Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:05:39.804113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3d3cbb3c86a4227a8fdd5c2bf117c9e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}] Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: c14e8c3e9e4944fbb37a4a633ce62734 Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '3cb1b98b-c3c7-45a4-9a3e-d447240a5f07'} Aug 04 21:05:39.805894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. (HTTP 404) (Request-ID: req-24afa218-b10d-46b8-9815-919bd6781489) Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.806907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:39.808281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 21:05:39.811065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c726412a-c2d8-490b-8c70-08073bad3af3 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Returning 404 to user: Snapshot 3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:39.813939 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c726412a-c2d8-490b-8c70-08073bad3af3 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07" status: 404 len: 111 microversion: 2.1 time: 0.040671 Aug 04 21:05:39.815768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8131cd64-96dc-4934-96f6-6c15a1a645ec tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda71ba60>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:39.820410 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 540/1114] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Aug 4 21:05:39 2022] GET /compute/v2.1/os-snapshots/3cb1b98b-c3c7-45a4-9a3e-d447240a5f07 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:05:39.883910 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8131cd64-96dc-4934-96f6-6c15a1a645ec tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 202 len: 0 microversion: 2.1 time: 0.072980 Aug 04 21:05:39.884761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 575/1115] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:05:39 2022] DELETE /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:05:39.893649 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1d94d5dc-ad5c-4bf5-86a4-53c5c1389574 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda06e310>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:39.948701 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1d94d5dc-ad5c-4bf5-86a4-53c5c1389574 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 200 len: 345 microversion: 2.1 time: 0.058851 Aug 04 21:05:39.952581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 541/1116] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:39 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:05:40.969936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9bb0e360-68fd-4648-b1d3-98269f24385d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda892e50>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:41.000958 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-9bb0e360-68fd-4648-b1d3-98269f24385d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] HTTP exception thrown: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9bb0e360-68fd-4648-b1d3-98269f24385d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Request method failure captured: Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c HTTP/1.1 Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DSSkNLuaVpJAmK1EMNAKQ6Pfzo8mSNfRGxttZh6TCX5Yogjdk3OEyaX9Prp7KskYcN6sG1nvw5IlU95tTU1n4JDXE0Qv7H95mbpz-tWQFEjJVzfIynkhb-nfK6uTsT9jRpqD1k0fH5o0NgkBbELP1oedQij3mjdkbKtmzNk7gKtzFc Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:05:41.003285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3d3cbb3c86a4227a8fdd5c2bf117c9e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}] Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: c14e8c3e9e4944fbb37a4a633ce62734 Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '5322b17b-2d49-4b29-a874-542321f0de1c'} Aug 04 21:05:41.005897 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. (HTTP 404) (Request-ID: req-5235e8b5-58d4-48a0-8e3a-43c3a9334d36) Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.006760 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:41.007975 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:05:41.010142 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.012912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.016848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9bb0e360-68fd-4648-b1d3-98269f24385d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Returning 404 to user: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:41.016848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9bb0e360-68fd-4648-b1d3-98269f24385d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 404 len: 109 microversion: 2.1 time: 0.051522 Aug 04 21:05:41.016848 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 576/1117] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:40 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:05:41.030783 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9614117a-ef88-4319-b189-35cb2c99e60d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bd9e813a0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:41.062231 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-9614117a-ef88-4319-b189-35cb2c99e60d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] HTTP exception thrown: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9614117a-ef88-4319-b189-35cb2c99e60d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Request method failure captured: Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c HTTP/1.1 Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DSSkNLuaVpJAmK1EMNAKQ6Pfzo8mSNfRGxttZh6TCX5Yogjdk3OEyaX9Prp7KskYcN6sG1nvw5IlU95tTU1n4JDXE0Qv7H95mbpz-tWQFEjJVzfIynkhb-nfK6uTsT9jRpqD1k0fH5o0NgkBbELP1oedQij3mjdkbKtmzNk7gKtzFc Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:05:41.064504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3d3cbb3c86a4227a8fdd5c2bf117c9e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}] Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: c14e8c3e9e4944fbb37a4a633ce62734 Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '5322b17b-2d49-4b29-a874-542321f0de1c'} Aug 04 21:05:41.065867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. (HTTP 404) (Request-ID: req-43ce42bf-b622-4ac2-90c3-9f5f906e94f9) Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.067246 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:05:41.068485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:05:41.069681 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9614117a-ef88-4319-b189-35cb2c99e60d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Returning 404 to user: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:41.070864 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9614117a-ef88-4319-b189-35cb2c99e60d tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 404 len: 109 microversion: 2.1 time: 0.039109 Aug 04 21:05:41.071713 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 542/1118] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Aug 4 21:05:41 2022] DELETE /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:05:41.075504 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ecd6183b-f4cb-4c17-8641-43ed17a42d62 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Calling method '.version_select at 0x7f2bda7450d0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:41.107963 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-ecd6183b-f4cb-4c17-8641-43ed17a42d62 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] HTTP exception thrown: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ecd6183b-f4cb-4c17-8641-43ed17a42d62 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Request method failure captured: Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c HTTP/1.1 Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DSSkNLuaVpJAmK1EMNAKQ6Pfzo8mSNfRGxttZh6TCX5Yogjdk3OEyaX9Prp7KskYcN6sG1nvw5IlU95tTU1n4JDXE0Qv7H95mbpz-tWQFEjJVzfIynkhb-nfK6uTsT9jRpqD1k0fH5o0NgkBbELP1oedQij3mjdkbKtmzNk7gKtzFc Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:05:41.110130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3d3cbb3c86a4227a8fdd5c2bf117c9e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3d3cbb3c86a4227a8fdd5c2bf117c9e"}]}] Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: b3d3cbb3c86a4227a8fdd5c2bf117c9e Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1489554646 Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: c14e8c3e9e4944fbb37a4a633ce62734 Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1489554646-project Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '5322b17b-2d49-4b29-a874-542321f0de1c'} Aug 04 21:05:41.111740 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. (HTTP 404) (Request-ID: req-de7beec8-442f-4134-ba9b-71f7b9e2c24d) Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.112683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:05:41.114542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:05:41.115691 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ecd6183b-f4cb-4c17-8641-43ed17a42d62 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] Returning 404 to user: Volume 5322b17b-2d49-4b29-a874-542321f0de1c could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ecd6183b-f4cb-4c17-8641-43ed17a42d62 tempest-VolumesSnapshotsTestJSON-1489554646 tempest-VolumesSnapshotsTestJSON-1489554646-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c" status: 404 len: 109 microversion: 2.1 time: 0.040133 Aug 04 21:05:41.117056 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 577/1119] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Aug 4 21:05:41 2022] GET /compute/v2.1/os-volumes/5322b17b-2d49-4b29-a874-542321f0de1c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:05:54.722784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1569881409", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "networks": [{"uuid": "31c5d2a5-7a25-4837-9998-3f6832fffef7"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:05:54.793290 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] validate_networks() for [('31c5d2a5-7a25-4837-9998-3f6832fffef7', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:05:55.261004 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:05:55.261433 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:05:55.261910 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:05:55.262320 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:05:55.262731 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:05:55.272974 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:55.273459 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:55.273894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:55.274620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:55.275078 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:55.275504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:55.293109 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Getting quotas for project d142eaffafa84ba89b53b2e8ab43639f. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:05:55.297060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Getting quotas for user b9319c0e1d7d4ced94b0817272b29bb4 and project d142eaffafa84ba89b53b2e8ab43639f. Resources: {'cores', 'instances', 'ram'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:05:55.308604 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:05:55.310876 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:05:55.357868 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-32351eb2-2527-4a76-bb1d-58b654347153 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639573 Aug 04 21:05:55.358426 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 543/1120] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:05:55.371714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-7ea2127e-34fd-447c-b992-8dba2d3c5313 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:55.372615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-7ea2127e-34fd-447c-b992-8dba2d3c5313 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:55.427852 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-7ea2127e-34fd-447c-b992-8dba2d3c5313 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:55.434518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-7ea2127e-34fd-447c-b992-8dba2d3c5313 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1219 microversion: 2.1 time: 0.067447 Aug 04 21:05:55.435080 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 578/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:55 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:56.457775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:56.458388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:56.464531 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:56.465019 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:56.465726 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:56.466425 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:56.466892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:56.467324 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:56.531045 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:56.539069 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-de2ab78e-9896-4624-842e-66f6da70fdfb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1223 microversion: 2.1 time: 0.086297 Aug 04 21:05:56.539627 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 544/1122] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:56 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:57.561153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:57.561782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:57.569096 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:57.569571 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:57.570000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:57.570683 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:57.571127 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:57.571548 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:57.646462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:57.654251 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c002fef5-50f8-4e96-8282-a579b308bc25 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1223 microversion: 2.1 time: 0.096932 Aug 04 21:05:57.654813 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 579/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:57 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:58.675296 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:58.675902 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:58.682643 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:58.683151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:58.683595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:58.684286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:58.684775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:58.685204 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:58.752374 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:58.760253 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9516cd10-5148-463e-a7f8-4654559df6f1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1223 microversion: 2.1 time: 0.089156 Aug 04 21:05:58.760843 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 545/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:58 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:59.781286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:05:59.781836 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:05:59.788979 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:59.789462 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:59.789903 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:59.790605 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:05:59.791084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:05:59.791483 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:05:59.874337 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:05:59.883842 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ab80fd44-3be0-4e38-8b63-20afd1a55a94 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1279 microversion: 2.1 time: 0.106410 Aug 04 21:05:59.893207 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 580/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:05:59 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:00.905750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:00.906367 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:00.913003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:00.913594 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:00.914157 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:00.914929 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:00.915452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:00.915947 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:01.137171 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:01.145348 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-249b7e62-28cb-4b43-8b31-7ae28336a660 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.243469 Aug 04 21:06:01.146001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 546/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:00 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:01.365105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be28192c-e0aa-4553-a3c9-2a97339dd1ab", "tag": "b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:06:01.374346 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:01.374798 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:01.375230 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:01.385788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] Creating event network-changed:b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b for instance be28192c-e0aa-4553-a3c9-2a97339dd1ab on hv-cinder-83602 Aug 04 21:06:01.390723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-2ecbfad8-fd9f-430d-b9ab-fa464d6f9af7 req-7cbe0a6a-b406-40f1-99e1-f193d7ecdfab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147292 Aug 04 21:06:01.391296 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 581/1127] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:06:02.166129 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:02.166746 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:02.173705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:02.174191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:02.174629 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:02.175907 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:02.176497 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:02.176932 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:02.305339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:02.312728 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1a404cf7-5f5d-4be3-93c2-89b995f4a9cb tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.150481 Aug 04 21:06:02.313321 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 547/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:02 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:03.335457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:03.336182 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:03.344070 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:03.344577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:03.345011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:03.345692 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:03.346143 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:03.346608 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:03.479840 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:03.488415 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8ca60f2c-6578-4ead-8c6f-071a7e364ce7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.156436 Aug 04 21:06:03.488993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 582/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:03 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:06:04.509755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:04.510390 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:04.516983 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:04.517475 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:04.517920 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:04.519085 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:04.519718 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:04.520232 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:04.746401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:04.753878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f69f949-21af-4528-b64f-9d7a02da2202 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.247971 Aug 04 21:06:04.754447 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 548/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:04 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:05.774795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:05.775409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:05.777879 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:05.783387 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:05.783869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:05.784567 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:05.785406 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:05.785864 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:05.786283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:05.917414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:05.926668 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e0415fb4-7a5b-4f1d-abd2-7e45ee9ddb90 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.155697 Aug 04 21:06:05.927239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 583/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:05 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:06.948815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:06.949429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:06.951275 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:06.951934 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:06.958555 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:06.959075 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:06.959512 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:06.960218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:06.960720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:06.961145 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:07.381562 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:07.389790 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a4ae76fe-213f-4c31-9a4d-724d60862d14 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.444801 Aug 04 21:06:07.390398 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 549/1132] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:06 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:08.410941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:08.411550 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:08.418708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:08.419356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:08.419797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:08.420537 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:08.420998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:08.421425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:08.582510 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:08.592416 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c80d8c56-3f43-47f2-9a6f-af4f83199e56 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.185533 Aug 04 21:06:08.593001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 584/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:08 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:09.615984 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:09.616616 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:09.622946 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:09.623431 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:09.623868 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:09.624607 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:09.625059 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:09.625486 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:09.757519 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:09.764989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6bb08065-da42-484c-8c3b-db1253b10049 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.154006 Aug 04 21:06:09.765552 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 550/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:09 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:10.787781 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:10.788539 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:10.796039 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:10.796650 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:10.797083 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:10.797802 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:10.798716 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:10.801576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:10.842165 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be28192c-e0aa-4553-a3c9-2a97339dd1ab", "name": "network-vif-plugged", "status": "completed", "tag": "b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:06:10.869501 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:10.869988 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:10.870422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:10.882801 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] Creating event network-vif-plugged:b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b for instance be28192c-e0aa-4553-a3c9-2a97339dd1ab on hv-cinder-83602 Aug 04 21:06:10.888445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-2bf9346e-749a-41a5-8e5c-8de6a2dc61d5 req-a14d8187-77b6-4487-86f0-feef0f458248 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221895 Aug 04 21:06:10.889164 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 585/1135] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:06:10.964948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:10.973909 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9a186ff5-f76e-4b20-bbe9-46b9bdc97303 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.190751 Aug 04 21:06:10.974494 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 551/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:10 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:06:12.000822 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:12.001967 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:12.011582 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:12.012569 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:12.013298 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:12.014409 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:12.015157 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:12.015861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:12.170159 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:12.182769 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-871ee271-8c3b-49d1-b47e-94c8e2d8d9ef tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1319 microversion: 2.1 time: 0.190114 Aug 04 21:06:12.183641 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 586/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:11 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:13.203620 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:06:13.204224 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:13.211971 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:13.212705 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:13.213147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:13.214063 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:13.214518 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:13.215105 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:13.366344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:06:13.374846 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-82f95e6b-5288-48b2-84c9-6c677f2023a9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1508 microversion: 2.1 time: 0.174922 Aug 04 21:06:13.375435 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 552/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:06:13 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:06:21.946238 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:06:21.946917 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:06:46.633529 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efab67df-f559-45c8-9f49-76c4b6dd8091", "device": "/dev/sdb"}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:06:46.636493 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:06:46.638837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=20 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:46.639495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=40 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:46.646828 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:46.647494 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:46.647984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:46.649011 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:06:46.649664 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:06:46.650146 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:06:46.948681 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e099afe5-909c-468a-92bd-8ec3e8e33830 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "POST /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319199 Aug 04 21:06:46.952575 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 587/1139] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:06:46 2022] POST /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:07:13.814566 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:13.815368 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=56 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:13.820018 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:13.820545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:13.827848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:13.828332 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:13.828813 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:13.829506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:13.829970 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:13.830401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:13.930542 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lazy-loading 'services' on Instance uuid be28192c-e0aa-4553-a3c9-2a97339dd1ab {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:07:14.002295 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-355de3ea-8550-4160-a735-fd7999604089 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab/os-volume_attachments/efab67df-f559-45c8-9f49-76c4b6dd8091" status: 202 len: 0 microversion: 2.1 time: 0.189133 Aug 04 21:07:14.003663 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 553/1140] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:07:13 2022] DELETE /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab/os-volume_attachments/efab67df-f559-45c8-9f49-76c4b6dd8091 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:07:15.127496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:15.128389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:15.132723 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:15.133301 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:15.140635 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:15.141119 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:15.141553 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:15.142243 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:15.142694 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:15.143115 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:15.168591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:07:15.245969 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8b9cecc7-2ed3-46b0-a2e3-1c37c1fbd015 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 204 len: 0 microversion: 2.1 time: 0.119689 Aug 04 21:07:15.246625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 588/1141] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:07:15 2022] DELETE /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:07:15.256464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:15.257182 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:15.263894 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:15.264403 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:15.264832 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:15.265511 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:15.265961 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:15.266379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:15.398160 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:15.405655 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef9d1e83-415e-43de-8099-fef1fc131bee tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1514 microversion: 2.1 time: 0.154029 Aug 04 21:07:15.406341 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 554/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:15 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:07:16.428697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:16.429396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:16.435728 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:16.436213 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:16.436693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:16.437389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:16.437847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:16.438274 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:16.568869 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:16.576283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-65f52374-55ad-4dc1-87da-d75476381fc9 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1514 microversion: 2.1 time: 0.152101 Aug 04 21:07:16.576876 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 589/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:16 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:17.598561 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:17.599147 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:17.605537 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:17.606017 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:17.606445 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:17.607131 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:17.607580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:17.608000 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:17.801545 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:17.809379 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-13d6af0a-e7d2-4122-9bb3-1b02a955aa5e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 200 len: 1514 microversion: 2.1 time: 0.214879 Aug 04 21:07:17.809946 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 555/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:17 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:07:18.014764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be28192c-e0aa-4553-a3c9-2a97339dd1ab", "name": "network-vif-deleted", "tag": "b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:07:18.027342 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:18.027777 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:18.028216 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:18.040515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] Creating event network-vif-deleted:b6885d4f-4c5c-4d14-9bf8-0a9e7a1e487b for instance be28192c-e0aa-4553-a3c9-2a97339dd1ab on hv-cinder-83602 Aug 04 21:07:18.045394 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-b061649f-252e-4f80-9e42-92ee9e934876 req-6c54568a-ac3b-4b25-b8fc-9633b52317a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034579 Aug 04 21:07:18.045993 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 590/1145] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:07:18.830749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:18.831360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: be28192c-e0aa-4553-a3c9-2a97339dd1ab] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:18.837927 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:18.838414 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:18.838883 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:18.839578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:18.840038 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:18.840499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:18.854203 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] HTTP exception thrown: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Request method failure captured: Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab HTTP/1.1 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DSwcEX_3IYiwC-yDGKfGkSzMouAt13sOuj0we3pudMSYZ93sqHhJ3RCvJ6U-tb5kIjSiSHns_FfCOGSXGBzVlgYOc_YP7-ei5TCjImYVyfFg-rsZRuSy-Aj6S9ehyfp5YbH9L_y4TZfr_CNDgDhB9yh4eL_HpNChECm_JkTuKyBWV4 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: d142eaffafa84ba89b53b2e8ab43639f Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:07:18.855867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d142eaffafa84ba89b53b2e8ab43639f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d142eaffafa84ba89b53b2e8ab43639f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d142eaffafa84ba89b53b2e8ab43639f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d142eaffafa84ba89b53b2e8ab43639f"}]}] Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: d142eaffafa84ba89b53b2e8ab43639f Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotTestJSON-1889781290-project Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: b9319c0e1d7d4ced94b0817272b29bb4 Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotTestJSON-1889781290-project Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. Aug 04 21:07:18.857694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': 'be28192c-e0aa-4553-a3c9-2a97339dd1ab'} Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:07:18.858694 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. Aug 04 21:07:18.860065 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:07:18.861356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Returning 404 to user: Instance be28192c-e0aa-4553-a3c9-2a97339dd1ab could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:07:18.861356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-013b847d-26f7-4005-88e0-2c8603ad32b2 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab" status: 404 len: 111 microversion: 2.1 time: 0.030428 Aug 04 21:07:18.861356 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 556/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:18 2022] GET /compute/v2.1/servers/be28192c-e0aa-4553-a3c9-2a97339dd1ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:07:28.924666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:28.925584 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:28.930000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-502568696", "imageRef": "ae5d0617-6353-473f-8d50-a8d4761baeff", "flavorRef": "452", "networks": [{"uuid": "31c5d2a5-7a25-4837-9998-3f6832fffef7"}]}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:07:28.987168 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] validate_networks() for [('31c5d2a5-7a25-4837-9998-3f6832fffef7', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:07:29.452693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:07:29.453153 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:07:29.453625 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:07:29.454032 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:07:29.454442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:07:29.463658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:29.464134 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:29.464600 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:29.465321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:29.465779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:29.466203 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:29.483102 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Getting quotas for project d142eaffafa84ba89b53b2e8ab43639f. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:07:29.487076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Getting quotas for user b9319c0e1d7d4ced94b0817272b29bb4 and project d142eaffafa84ba89b53b2e8ab43639f. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:07:29.498829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:07:29.501236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5d0617-6353-473f-8d50-a8d4761baeff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:07:29.545303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [f1adb8b9-f2cd-4c7e-80ae-3c327648828b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:07:30.553495 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [f1adb8b9-f2cd-4c7e-80ae-3c327648828b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56196. Aug 04 21:07:30.557706 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9dfba506-2a51-461c-8bf4-5fa28b07420d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634827 Aug 04 21:07:30.558356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 591/1147] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:07:30.569602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-819e6255-c127-433a-a59d-9a42d2ce4eed tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:30.570211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-819e6255-c127-433a-a59d-9a42d2ce4eed tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:30.572767 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=8 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:30.573411 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:30.637556 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-819e6255-c127-433a-a59d-9a42d2ce4eed tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:30.645155 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-819e6255-c127-433a-a59d-9a42d2ce4eed tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1218 microversion: 2.1 time: 0.079090 Aug 04 21:07:30.645605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 557/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:30 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:31.666534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:31.667239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:31.674651 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:31.675256 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:31.676029 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:31.676936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:31.677439 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:31.677904 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:31.768140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:31.776613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-dbbeee56-f9a7-4cd2-bb0e-ae05686ba54f tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1276 microversion: 2.1 time: 0.114784 Aug 04 21:07:31.777241 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 592/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:31 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:32.798534 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:32.799150 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:32.807441 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:32.807933 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:32.808417 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:32.809123 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:32.809606 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:32.810034 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:32.853779 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afe9b16-067e-4c3a-aba8-978fee6b8725", "tag": "80b362e1-cd1c-4112-b3a9-3a821d700b43"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:07:32.864421 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:32.865139 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:32.865639 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:32.877200 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] Creating event network-changed:80b362e1-cd1c-4112-b3a9-3a821d700b43 for instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 on hv-cinder-83602 Aug 04 21:07:32.883161 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-09dc239f-f4c6-4841-bdfd-fba1ea7f50f9 req-1b8740cd-df76-4841-97eb-7175e7868d53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Aug 04 21:07:32.884021 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 593/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:07:33.027893 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:33.036720 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-edfbc2b3-82ce-4457-a73c-4f9efff71af1 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.242259 Aug 04 21:07:33.037305 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 558/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:32 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:34.058830 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:34.059517 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:34.065597 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:34.066118 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:34.066552 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:34.067229 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:34.067678 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:34.068098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:34.198177 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:34.205513 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f609872e-ef10-4616-a560-af98219fd969 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.151457 Aug 04 21:07:34.206068 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 594/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:34 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:35.227835 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:35.228485 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:35.235088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:35.235582 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:35.236021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:35.236756 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:35.237216 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:35.237648 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:35.370283 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:35.378124 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ac8f29c-a733-4ad1-8aff-691ec976d70e tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.154924 Aug 04 21:07:35.378731 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 559/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:35 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:36.400321 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:36.401078 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:36.407470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:36.407943 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:36.408396 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:36.409079 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:36.409526 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:36.409941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:36.545425 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:36.553051 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-cb33376b-5b06-4971-9263-1557a425b531 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.158061 Aug 04 21:07:36.553612 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 595/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:36 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:37.329878 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afe9b16-067e-4c3a-aba8-978fee6b8725", "name": "network-vif-plugged", "status": "completed", "tag": "80b362e1-cd1c-4112-b3a9-3a821d700b43"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:07:37.340516 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:37.340973 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:37.341404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:37.353772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] Creating event network-vif-plugged:80b362e1-cd1c-4112-b3a9-3a821d700b43 for instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 on hv-cinder-83602 Aug 04 21:07:37.358958 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d479e9e2-ab64-46ae-be54-314ece81ede4 req-ff6c2456-3ab4-48f3-9872-a7dcef917433 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Aug 04 21:07:37.359656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 560/1155] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:07:37.575757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:37.576957 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:37.583616 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:37.584103 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:37.584568 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:37.585269 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:37.585722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:37.586187 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:37.715875 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:37.723202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-aa2ac532-5569-42d9-b68c-4294a8625c83 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.152535 Aug 04 21:07:37.723757 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 596/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:37 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:38.744759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:38.745383 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:38.751730 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:38.752220 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:38.752811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:38.753508 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:38.753963 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:38.754390 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:38.890840 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:38.898213 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cbb133bf-e3eb-4155-bd39-2798fb998a0b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1318 microversion: 2.1 time: 0.158884 Aug 04 21:07:38.899451 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 561/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:38 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:39.919800 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:07:39.920534 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:39.923152 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:39.923942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:39.929320 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:39.929797 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:39.930266 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:39.931222 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:39.931680 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:39.932109 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:40.059677 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:07:40.067155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-ec41652a-e3d0-405b-aea3-ac49ed43a909 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1507 microversion: 2.1 time: 0.152097 Aug 04 21:07:40.067721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 597/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:07:39 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:07:40.089169 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "861fb013-e613-4f88-8ea4-517c1f65df4a", "device": "/dev/sdb"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:07:40.092037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:07:40.098406 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:40.098897 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:40.099339 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:40.100031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:07:40.100522 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:07:40.100955 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:07:40.360420 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2ff9b93f-fc14-405a-bfa9-4a8b103f8d45 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "POST /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275249 Aug 04 21:07:40.361205 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 562/1159] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Aug 4 21:07:40 2022] POST /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:07:52.076402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:07:52.076955 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:08:01.776642 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:01.777245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:01.778947 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:01.779730 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=34 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:01.785620 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:01.786124 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:01.786554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:01.787237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:01.787685 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:01.788105 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:01.870782 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.objects.instance [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lazy-loading 'services' on Instance uuid 1afe9b16-067e-4c3a-aba8-978fee6b8725 {{(pid=124352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:08:01.944202 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-a8b30912-cd45-4f8a-acb2-dc83839b118a tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725/os-volume_attachments/861fb013-e613-4f88-8ea4-517c1f65df4a" status: 202 len: 0 microversion: 2.1 time: 0.171634 Aug 04 21:08:01.944829 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 598/1160] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Aug 4 21:08:01 2022] DELETE /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725/os-volume_attachments/861fb013-e613-4f88-8ea4-517c1f65df4a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:08:03.061595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:03.062042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=14 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:03.062499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:03.066576 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:03.067156 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:03.075890 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:03.076421 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:03.076867 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:03.077574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:03.078038 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:03.078469 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:03.106250 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:08:03.178972 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc322fbf-7942-4df6-bca5-e09b5e9c102b tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 204 len: 0 microversion: 2.1 time: 0.119067 Aug 04 21:08:03.179557 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 563/1161] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:08:03 2022] DELETE /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:08:03.189631 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:03.190316 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:03.196381 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:03.196853 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:03.197279 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:03.198071 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:03.198744 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:03.199155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:03.331158 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:03.339856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5d44d147-fd1f-4d0e-8028-0726ca3f918c tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.153763 Aug 04 21:08:03.340464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 599/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:03 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:04.362585 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:04.363259 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:04.372495 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:04.373168 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:04.373741 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:04.374838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:04.375479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:04.376015 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:04.507953 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:04.517022 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cb6bc52a-695d-4e68-bdcf-129e4d7f4d8d tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.158718 Aug 04 21:08:04.517596 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 564/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:04 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:05.537846 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:05.538457 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:05.545018 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:05.545503 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:05.545942 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:05.546634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:05.547089 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:05.547516 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:05.678411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:05.686762 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-97bf7034-b19b-4504-803d-4ebc2fc157d7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.152802 Aug 04 21:08:05.687339 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 600/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:05 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:06.707942 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:06.708578 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:06.716248 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:06.716754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:06.717191 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:06.717880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:06.718333 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:06.718755 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:06.851975 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:06.859551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4573fccc-a9d2-4cca-ad60-067597f3f0af tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.155564 Aug 04 21:08:06.860126 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 565/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:06 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:07.881476 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:07.882211 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:07.889640 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:07.890122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:07.890549 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:07.891591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:07.891722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:07.892130 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:08.021454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:08.029756 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-8eb50e31-b524-4dcd-a52a-f7abd8bd3fc7 tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.152463 Aug 04 21:08:08.030311 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 601/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:07 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:09.050452 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:09.051052 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:09.058116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:09.058528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:09.058959 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:09.059656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:09.060116 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:09.060564 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:09.301759 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9319c0e1d7d4ced94b0817272b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd142eaffafa84ba89b53b2e8ab43639f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:09.309887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d29ab6a6-6e46-42a6-bd7f-66070a7bbbec tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 200 len: 1513 microversion: 2.1 time: 0.263380 Aug 04 21:08:09.310923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 566/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:09 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:09.445917 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afe9b16-067e-4c3a-aba8-978fee6b8725", "name": "network-vif-deleted", "tag": "80b362e1-cd1c-4112-b3a9-3a821d700b43"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:08:09.460133 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:09.460617 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:09.460898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:09.473873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] Creating event network-vif-deleted:80b362e1-cd1c-4112-b3a9-3a821d700b43 for instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 on hv-cinder-83602 Aug 04 21:08:09.479634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-4d7e9d4d-97f5-45f1-bcb9-1ce296f48fb2 req-ad0bd68a-fa00-4ef8-ac0c-a825628704f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038383 Aug 04 21:08:09.480444 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 602/1168] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:08:10.331122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:10.331919 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] [instance: 1afe9b16-067e-4c3a-aba8-978fee6b8725] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:10.339654 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:10.340240 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:10.340774 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:10.341581 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:10.342043 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:10.342472 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:10.357382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] HTTP exception thrown: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Request method failure captured: Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 HTTP/1.1 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DSwcEX_3IYiwC-yDGKfGkSzMouAt13sOuj0we3pudMSYZ93sqHhJ3RCvJ6U-tb5kIjSiSHns_FfCOGSXGBzVlgYOc_YP7-ei5TCjImYVyfFg-rsZRuSy-Aj6S9ehyfp5YbH9L_y4TZfr_CNDgDhB9yh4eL_HpNChECm_JkTuKyBWV4 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: d142eaffafa84ba89b53b2e8ab43639f Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:08:10.359071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d142eaffafa84ba89b53b2e8ab43639f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d142eaffafa84ba89b53b2e8ab43639f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d142eaffafa84ba89b53b2e8ab43639f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d142eaffafa84ba89b53b2e8ab43639f"}]}] Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: d142eaffafa84ba89b53b2e8ab43639f Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1889781290 Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotTestJSON-1889781290-project Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: b9319c0e1d7d4ced94b0817272b29bb4 Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotTestJSON-1889781290-project Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. Aug 04 21:08:10.360889 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '1afe9b16-067e-4c3a-aba8-978fee6b8725'} Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:08:10.361880 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. Aug 04 21:08:10.363551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:08:10.365625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] Returning 404 to user: Instance 1afe9b16-067e-4c3a-aba8-978fee6b8725 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:08:10.365625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fb26cf45-005d-4142-8bf0-48721ca444bd tempest-VolumesSnapshotTestJSON-1889781290 tempest-VolumesSnapshotTestJSON-1889781290-project] 10.222.0.52 "GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725" status: 404 len: 111 microversion: 2.1 time: 0.033261 Aug 04 21:08:10.365625 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 567/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:10 2022] GET /compute/v2.1/servers/1afe9b16-067e-4c3a-aba8-978fee6b8725 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:08:13.987464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2142387015", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367343419", "security_groups": [{"name": "tempest-secgroup-smoke-1969714044"}], "block_device_mapping_v2": [{"uuid": "eee6deb4-74fc-48d4-b86a-396a6304fdf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28abb33f-5ab1-4183-ab52-0944bb76f54a"}]}} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:08:14.107167 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.network.neutron [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] validate_networks() for [('28abb33f-5ab1-4183-ab52-0944bb76f54a', None, None, None, None, None)] {{(pid=124352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:08:14.500972 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:08:14.501405 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image limits 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:08:14.501883 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Flavor pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:08:14.502293 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Image pref 0:0:0 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:08:14.502708 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.virt.hardware [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:08:14.512912 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:14.513404 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:14.513845 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:14.514576 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:14.515055 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:14.515481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:14.533451 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:08:14.537426 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.quota [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Getting quotas for user 3f4c9c7f2ddd4403b13696794dfaab5d and project 7535eb1709bc4bfe8a1e251fb0db4593. Resources: {'cores', 'instances', 'ram'} {{(pid=124352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:08:14.595926 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Going to run 1 instances... {{(pid=124352) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:08:14.598171 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eee6deb4-74fc-48d4-b86a-396a6304fdf0',volume_size=None,volume_type=None)] {{(pid=124352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:08:14.731911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5c6002e1-efd1-4ce6-be0e-7713aff0606b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749301 Aug 04 21:08:14.732888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 603/1170] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Aug 4 21:08:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:08:14.744031 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a699af91-05d3-423e-8467-b2db9f09c774 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:14.745479 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a699af91-05d3-423e-8467-b2db9f09c774 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:14.802008 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a699af91-05d3-423e-8467-b2db9f09c774 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:14.810211 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a699af91-05d3-423e-8467-b2db9f09c774 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1094 microversion: 2.1 time: 0.070242 Aug 04 21:08:14.810717 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 568/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:14 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:15.831456 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:15.832000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:15.840042 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:15.840911 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:15.841551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:15.842551 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:15.843063 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:15.843490 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:15.905376 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:15.912998 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f82ba1be-ba33-4c1e-aa2b-41850e77783c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1192 microversion: 2.1 time: 0.085803 Aug 04 21:08:15.913388 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 604/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:15 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:16.935062 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:16.935708 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:16.942989 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:16.943471 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:16.943908 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:16.944621 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:16.945074 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:16.945499 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:17.006377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:17.014482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-068cd5ab-ff5e-4e8e-9351-1739f614dce4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1192 microversion: 2.1 time: 0.083806 Aug 04 21:08:17.015049 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 569/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:16 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:18.035577 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:18.036224 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:18.042878 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:18.043364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:18.043805 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:18.044536 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:18.045000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:18.045431 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:18.109923 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:18.117525 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-fcf9812c-0a0e-449c-8988-5a1620a959fa tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1192 microversion: 2.1 time: 0.085874 Aug 04 21:08:18.118090 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 605/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:18 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:19.138766 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:19.139357 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:19.145887 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:19.146382 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:19.146820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:19.147504 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:19.148734 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:19.149369 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:19.215040 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:19.222708 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-39e406ca-9806-4d00-88f8-9e2abfb710fe tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1192 microversion: 2.1 time: 0.088032 Aug 04 21:08:19.223273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 570/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:19 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:20.244652 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:20.245458 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:20.252481 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:20.252974 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:20.253411 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:20.254111 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:20.254565 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:20.254986 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:20.491515 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:20.500045 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-73687008-11a9-428e-8c2e-bee01865288f tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1278 microversion: 2.1 time: 0.259692 Aug 04 21:08:20.500666 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 606/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:20 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:21.101661 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbe4339-ac5f-496b-b38f-8178c05ebf81", "tag": "ceb317bb-ace2-489e-8cd0-f712c6ab8055"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:08:21.114273 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:21.114800 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:21.115285 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:21.127670 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] Creating event network-changed:ceb317bb-ace2-489e-8cd0-f712c6ab8055 for instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 on hv-cinder-83602 Aug 04 21:08:21.132609 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e9846ee7-0fde-40c2-a84c-b2f6cbc1c250 req-a77d35fd-7417-4868-8e8c-d14d4a6ae60c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034704 Aug 04 21:08:21.133207 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 571/1177] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:08:21.527400 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:21.528163 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:21.540518 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:21.542364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:21.543001 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:21.543940 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:21.544714 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:21.545803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:21.705821 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:21.714026 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-1a7387f6-61ae-44a5-a673-d9622b912286 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.194554 Aug 04 21:08:21.714591 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 607/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:21 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:22.736064 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:22.737377 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:22.743892 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:22.744586 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:22.745254 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:22.746162 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:22.746789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:22.747060 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:22.959754 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:22.968226 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-97077072-e53f-4a1b-a3bf-0a36261a3167 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.236809 Aug 04 21:08:22.968827 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 572/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:22 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:23.989250 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:23.989854 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:23.997595 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:23.998140 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:23.998622 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:23.999428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:24.000043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:24.000697 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:24.149453 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:24.157732 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d08bb459-50f1-445f-b4d2-39e7340006b5 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.172260 Aug 04 21:08:24.158287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 608/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:23 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:08:25.179037 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:25.179644 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:25.182289 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:25.187515 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:25.188005 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:25.188464 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:25.189158 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:25.189605 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:25.190021 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:25.347853 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:25.355882 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-368e5c7d-4e2e-493b-b380-8a6fcde8c85a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.180602 Aug 04 21:08:25.356567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 573/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:25 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:26.376558 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:26.377169 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:26.379083 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=2 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:26.379734 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell0:SELECT=6 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:26.387315 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:26.387803 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:26.388240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:26.388959 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:26.389414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:26.389839 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:26.526291 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:26.533892 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-48ada3b6-3b5f-4a20-8272-c621bdc2bc6c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.161193 Aug 04 21:08:26.534454 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 609/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:26 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:08:27.553978 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:27.554523 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:27.561520 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:27.562003 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:27.562436 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:27.563120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:27.563571 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:27.563993 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:27.697364 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:27.705698 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c20ddc0-e2a9-433f-9fd3-c5c411f1881b tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.155555 Aug 04 21:08:27.706265 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 574/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:27 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:28.727793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:28.728371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:28.734815 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:28.735294 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:28.735722 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:28.736423 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:28.736873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:28.737288 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:28.873239 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:28.880662 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-acfd1935-2b66-4644-ac93-fd7ee3e650bc tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.156765 Aug 04 21:08:28.881220 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 610/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:28 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:29.901747 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:29.902401 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:29.908820 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:29.909311 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:29.909750 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:29.910465 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:29.910923 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:29.911348 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:30.050738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:30.059307 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e8ea4058-d45f-46ac-8437-38cdc611c600 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.162008 Aug 04 21:08:30.059869 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 575/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:29 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:31.081578 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:31.082193 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:31.089379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:31.089978 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:31.090422 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:31.091121 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:31.091614 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:31.092043 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:31.229886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:31.237660 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-f95acc47-5f63-459e-badc-00e6801ce4f9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.160285 Aug 04 21:08:31.238237 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 611/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:31 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:32.260053 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:32.261178 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:32.268307 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:32.268818 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:32.269256 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:32.269948 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:32.270405 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:32.270825 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:32.409444 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:32.417023 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0997d8b5-9caa-4b96-8878-96b902c010e8 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.162566 Aug 04 21:08:32.417659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 576/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:32 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:33.440137 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:33.440793 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:33.443168 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.449034 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:33.449795 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:33.450361 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:33.451183 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:33.451780 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:33.452218 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:33.457115 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.589763 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:33.597364 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-c5df786a-fcf4-4220-8458-ee7731b3771c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.161566 Aug 04 21:08:33.597941 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 612/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:33 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:34.619272 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:34.619877 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:34.622360 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:34.627659 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:34.628142 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:34.628599 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:34.629288 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:34.629738 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:34.630165 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:34.635042 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:34.767602 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:34.774980 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49b6f23f-c396-4b1f-928c-d3e6e4565235 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.160210 Aug 04 21:08:34.775528 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 577/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:34 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:35.519823 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbe4339-ac5f-496b-b38f-8178c05ebf81", "name": "network-vif-plugged", "status": "completed", "tag": "ceb317bb-ace2-489e-8cd0-f712c6ab8055"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:08:35.530922 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:35.531688 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:35.532176 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:35.543663 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] Creating event network-vif-plugged:ceb317bb-ace2-489e-8cd0-f712c6ab8055 for instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 on hv-cinder-83602 Aug 04 21:08:35.549254 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-ca880225-8169-443a-b413-61c164bf5f62 req-2eb5b8ca-4420-46f6-8e90-19b3101bb387 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Aug 04 21:08:35.549847 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 613/1190] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:08:35.795842 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:35.796492 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:35.803298 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:35.803785 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:35.804218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:35.804940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:35.805388 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:35.805816 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:35.952404 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:35.959784 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-793c913d-5b32-4312-90f1-d405477c4bf7 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.168020 Aug 04 21:08:35.960343 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 578/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:35 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:36.982402 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:36.983122 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:36.989282 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:36.989768 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:36.990205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:36.990894 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:36.991356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:36.991784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:37.131778 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:37.139500 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d62e6b64-1ddd-41e1-afdc-4e74c30f48cb tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1266 microversion: 2.1 time: 0.161885 Aug 04 21:08:37.140002 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 614/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:36 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:38.160206 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:38.160840 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:38.167789 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:38.168308 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:38.168900 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:38.169838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:38.170429 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:38.170871 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:38.301567 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:38.309146 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0e8ca807-6e95-43ab-87a4-e4dbc0da56c0 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1454 microversion: 2.1 time: 0.152753 Aug 04 21:08:38.310281 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 579/1193] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:38 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:08:38.330356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:08:38.330961 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:08:38.337410 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:38.337886 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:38.338317 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:38.339000 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:38.339447 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:38.339871 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:38.478428 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:08:38.486098 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-5d5d247b-d2b1-4c1b-a64a-572d380ce4ca tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1454 microversion: 2.1 time: 0.159533 Aug 04 21:08:38.486658 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 615/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:08:38 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:08:40.753589 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbe4339-ac5f-496b-b38f-8178c05ebf81", "tag": "ceb317bb-ace2-489e-8cd0-f712c6ab8055"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:08:40.770981 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:08:40.771544 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:08:40.771985 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:08:40.801325 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] Creating event network-changed:ceb317bb-ace2-489e-8cd0-f712c6ab8055 for instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 on hv-cinder-83602 Aug 04 21:08:40.806913 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f8f97c0b-2515-4d19-9dfa-f74386d0af84 req-58e15ee8-be4f-49c7-862d-354a9dc7d32b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057502 Aug 04 21:08:40.807551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 580/1195] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:09:41.956595 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:09:41.957303 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:10:56.434984 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30be543b-4993-49e1-8db4-dae26caf4592] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 21:10:56.437622 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f71369a9-16d7-4ae7-88c7-13623ba5d3c7] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 21:10:56.438222 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=7 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:10:56.438784 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:10:56.439195 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=19 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:10:56.439721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:10:56.442075 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_api:SELECT=7 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:10:56.442908 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG dbcounter [-] [124352] Writing DB stats nova_cell1:SELECT=19 {{(pid=124352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:10:56.445433 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbe4339-ac5f-496b-b38f-8178c05ebf81", "tag": "ceb317bb-ace2-489e-8cd0-f712c6ab8055"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:10:56.448788 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:56.449285 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:56.449721 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:56.450414 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:56.450860 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:56.451470 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:56.457153 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:56.457848 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:56.458284 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:56.470775 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] Creating event network-changed:ceb317bb-ace2-489e-8cd0-f712c6ab8055 for instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 on hv-cinder-83602 Aug 04 21:10:56.474386 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] [630cdd80-b9c5-4935-94e0-6c79be583dfc] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:10:56.480019 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Going to try to terminate instance {{(pid=124352) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:10:56.559613 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-69388b96-6aa0-4944-b7c2-7d792962ea65 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 204 len: 0 microversion: 2.1 time: 0.127193 Aug 04 21:10:56.560615 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 616/1196] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:10:56 2022] DELETE /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:10:56.570107 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:10:56.571217 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:10:56.577275 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:56.577764 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:56.578205 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:56.578900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:56.579367 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:56.579802 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:56.843514 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:10:56.851160 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-3a23fba6-712e-40a9-82f1-cbf52623a251 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1579 microversion: 2.1 time: 0.285226 Aug 04 21:10:56.851726 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 617/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:10:56 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1579 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:10:57.446197 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] [f71369a9-16d7-4ae7-88c7-13623ba5d3c7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56798. Aug 04 21:10:57.481497 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] [630cdd80-b9c5-4935-94e0-6c79be583dfc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56800. Aug 04 21:10:57.484692 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-3f8fab49-82d8-4965-98c5-a0bd7009dc7d req-59365215-e9df-47fb-a44d-dc005004ec7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050468 Aug 04 21:10:57.485286 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 581/1198] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:10:57.873155 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:10:57.873954 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:10:57.882245 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:57.883003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:57.883443 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:57.884147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:57.884634 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:57.885581 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:57.891689 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] [30be543b-4993-49e1-8db4-dae26caf4592] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56804. Aug 04 21:10:58.109076 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:10:58.116888 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-9e3d0833-d301-4070-948b-7c768608e991 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1579 microversion: 2.1 time: 0.247703 Aug 04 21:10:58.117464 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 618/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:10:57 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1579 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:10:59.140976 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:10:59.141838 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:10:59.147925 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:59.148506 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:59.148950 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:59.149656 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:59.150113 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:59.151225 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:59.255530 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbe4339-ac5f-496b-b38f-8178c05ebf81", "name": "network-vif-deleted", "tag": "ceb317bb-ace2-489e-8cd0-f712c6ab8055"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:10:59.269936 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:10:59.270417 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:10:59.270856 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:10:59.284967 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:10:59.285147 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] Creating event network-vif-deleted:ceb317bb-ace2-489e-8cd0-f712c6ab8055 for instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 on hv-cinder-83602 Aug 04 21:10:59.290621 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-2b092c9a-2579-498a-a86e-4ad41d5d1cb9 req-c451702d-5601-43e2-a6cf-3c46ccdc8920 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107694 Aug 04 21:10:59.292203 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 619/1200] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:10:59.294911 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49132e05-ffae-46d9-b9bf-6d01a966825a tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 200 len: 1392 microversion: 2.1 time: 0.158969 Aug 04 21:10:59.295482 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 582/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:10:59 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:11:00.317445 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:00.318144 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 0fbe4339-ac5f-496b-b38f-8178c05ebf81] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:00.325773 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:00.326255 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:00.326693 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:00.327379 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:00.327837 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:00.328286 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:00.341831 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] HTTP exception thrown: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Request method failure captured: Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 HTTP/1.1 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DOpNoS386_6DFJ1kUF5D1-U6BZ-ES-CWNMtQ1D2TMak1XNG_A-eLUvq3Tys7IcQ5Ka-ddCDOf7JE5fABE_1Qq4EV0nRaOMUZxE3bTV0aoMpql2Igmz5pbbKxY4pcN1a5_GndVn6NV3tWJL9W-HRJlcPjL6Bng4lWS1PmiOyojptpps Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:11:00.343442 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7535eb1709bc4bfe8a1e251fb0db4593", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7535eb1709bc4bfe8a1e251fb0db4593"}]}] Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 3f4c9c7f2ddd4403b13696794dfaab5d Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. Aug 04 21:11:00.345356 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '0fbe4339-ac5f-496b-b38f-8178c05ebf81'} Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:11:00.346262 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. Aug 04 21:11:00.348128 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:00.349667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Returning 404 to user: Instance 0fbe4339-ac5f-496b-b38f-8178c05ebf81 could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:11:00.349667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-0e8ff2c3-de2c-4fcf-a852-f8871c599293 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81" status: 404 len: 111 microversion: 2.1 time: 0.031733 Aug 04 21:11:00.349667 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 620/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:11:00 2022] GET /compute/v2.1/servers/0fbe4339-ac5f-496b-b38f-8178c05ebf81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:11:03.413462 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:03.414365 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:03.422536 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:03.423103 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:03.423613 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:03.424674 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:03.425344 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:03.425811 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:03.452749 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:11:03.472236 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9653f7b5-c1c6-4682-aa34-1ed163fe7bb9", "tag": "15a3f91d-55f2-4699-9db5-0904c7ab1b1d"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:11:03.482303 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:03.483114 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:03.483284 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:03.497371 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] Creating event network-changed:15a3f91d-55f2-4699-9db5-0904c7ab1b1d for instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 on hv-cinder-83602 Aug 04 21:11:03.503053 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-a4b1992d-302d-4cf0-bc3b-74cfa8a21b4a req-971e6156-5789-4827-b7ca-b274693fa5c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091704 Aug 04 21:11:03.503893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 621/1203] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:11:03.540828 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9fa15137-940b-4d66-847b-b54531fd6710 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 204 len: 0 microversion: 2.1 time: 0.130950 Aug 04 21:11:03.542395 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 583/1204] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:11:03 2022] DELETE /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:11:03.560256 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:03.561084 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:03.568755 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:03.569283 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:03.569742 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:03.570496 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:03.570966 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:03.571389 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:03.718799 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.policy [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:11:03.726326 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-e0afed3e-34c6-4773-a614-ab418fda505c tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1577 microversion: 2.1 time: 0.172544 Aug 04 21:11:03.726898 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 622/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:11:03 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:11:04.748139 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:04.748944 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:04.755251 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:04.755732 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:04.756167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:04.756874 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:04.757328 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:04.757736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:04.974148 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4c9c7f2ddd4403b13696794dfaab5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535eb1709bc4bfe8a1e251fb0db4593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:11:04.983676 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b960e844-ba12-4b2d-a2c6-51456d790a41 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 200 len: 1459 microversion: 2.1 time: 0.240093 Aug 04 21:11:04.984245 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 584/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:11:04 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 1459 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:11:05.517873 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9653f7b5-c1c6-4682-aa34-1ed163fe7bb9", "name": "network-vif-deleted", "tag": "15a3f91d-55f2-4699-9db5-0904c7ab1b1d"}]} {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:11:05.528362 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:05.528861 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:05.529290 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:05.542649 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.compute.server_external_events [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] Creating event network-vif-deleted:15a3f91d-55f2-4699-9db5-0904c7ab1b1d for instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 on hv-cinder-83602 Aug 04 21:11:05.547587 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [req-739857e5-e62b-4c6f-b945-97175bab57c9 req-fe5d5d19-5494-4d54-b47a-5e42534a77bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Aug 04 21:11:05.548129 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 623/1207] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Aug 4 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:11:06.006120 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:06.006692 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:06.013071 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.013560 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.014001 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.014693 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.015151 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.015580 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.028940 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] HTTP exception thrown: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Request method failure captured: Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 HTTP/1.1 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DOpNoS386_6DFJ1kUF5D1-U6BZ-ES-CWNMtQ1D2TMak1XNG_A-eLUvq3Tys7IcQ5Ka-ddCDOf7JE5fABE_1Qq4EV0nRaOMUZxE3bTV0aoMpql2Igmz5pbbKxY4pcN1a5_GndVn6NV3tWJL9W-HRJlcPjL6Bng4lWS1PmiOyojptpps Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:11:06.030574 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7535eb1709bc4bfe8a1e251fb0db4593", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7535eb1709bc4bfe8a1e251fb0db4593"}]}] Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 3f4c9c7f2ddd4403b13696794dfaab5d Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. Aug 04 21:11:06.032375 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '9653f7b5-c1c6-4682-aa34-1ed163fe7bb9'} Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:11:06.033548 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. Aug 04 21:11:06.035316 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.037013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Returning 404 to user: Instance 9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:11:06.037013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0e7017e5-485d-4f59-8d0c-178fd76c77f4 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9" status: 404 len: 111 microversion: 2.1 time: 0.029866 Aug 04 21:11:06.037013 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 585/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:11:06 2022] GET /compute/v2.1/servers/9653f7b5-c1c6-4682-aa34-1ed163fe7bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:11:06.475287 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:06.475872 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.compute.api [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124352) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:06.482893 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.483375 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.483812 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.484542 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.485003 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.485427 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG oslo_concurrency.lockutils [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.498491 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.wsgi [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] HTTP exception thrown: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Request method failure captured: Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: request: DELETE /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e HTTP/1.1 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept: application/json Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Accept-Encoding: identity Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Connection: close Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Length: 0 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Content-Type: application/json Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Host: 10.222.0.52 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Openstack-System-Scope: None Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: User-Agent: python-urllib3/1.26.11 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Auth-Token: gAAAAABi7DOpNoS386_6DFJ1kUF5D1-U6BZ-ES-CWNMtQ1D2TMak1XNG_A-eLUvq3Tys7IcQ5Ka-ddCDOf7JE5fABE_1Qq4EV0nRaOMUZxE3bTV0aoMpql2Igmz5pbbKxY4pcN1a5_GndVn6NV3tWJL9W-HRJlcPjL6Bng4lWS1PmiOyojptpps Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Id: None Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Domain-Name: None Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Identity-Status: Confirmed Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Is-Admin-Project: True Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Id: default Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Domain-Name: Default Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Project-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Role: reader,member Aug 04 21:11:06.500125 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Roles: reader,member Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7535eb1709bc4bfe8a1e251fb0db4593", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7535eb1709bc4bfe8a1e251fb0db4593"}]}] Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-Tenant-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Id: default Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Domain-Name: Default Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Id: 3f4c9c7f2ddd4403b13696794dfaab5d Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: X-User-Name: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: method: > Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: exception: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.501859 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: action_args: {'id': '46d281c9-228e-4aeb-8054-fb5ac796724e'} Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:11:06.502900 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.504535 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.506231 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Returning 404 to user: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. {{(pid=124352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:11:06.506231 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-80a2f926-1c9c-4709-93f2-a2e6d8fc8168 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "DELETE /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 404 len: 111 microversion: 2.1 time: 0.030732 Aug 04 21:11:06.506231 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 624/1209] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Aug 4 21:11:06 2022] DELETE /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:11:06.510167 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:06.510772 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [instance: 46d281c9-228e-4aeb-8054-fb5ac796724e] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:11:06.517177 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.517615 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.518054 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.518765 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Acquiring lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:11:06.519218 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:11:06.519642 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Lock "bc954cb4-bb24-40a9-85b5-b62168d68e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:11:06.533837 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] HTTP exception thrown: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Request method failure captured: Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e HTTP/1.1 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept: application/json Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Connection: close Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Length: 0 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Content-Type: application/json Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Host: 10.222.0.52 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.11 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABi7DOpNoS386_6DFJ1kUF5D1-U6BZ-ES-CWNMtQ1D2TMak1XNG_A-eLUvq3Tys7IcQ5Ka-ddCDOf7JE5fABE_1Qq4EV0nRaOMUZxE3bTV0aoMpql2Igmz5pbbKxY4pcN1a5_GndVn6NV3tWJL9W-HRJlcPjL6Bng4lWS1PmiOyojptpps Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Role: reader,member Aug 04 21:11:06.535335 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Roles: reader,member Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7535eb1709bc4bfe8a1e251fb0db4593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7535eb1709bc4bfe8a1e251fb0db4593", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7535eb1709bc4bfe8a1e251fb0db4593"}]}] Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7535eb1709bc4bfe8a1e251fb0db4593 Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-818687791 Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Id: 3f4c9c7f2ddd4403b13696794dfaab5d Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-818687791-project Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: method: > Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: exception: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.537122 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: action_args: {'id': '46d281c9-228e-4aeb-8054-fb5ac796724e'} Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:11:06.538201 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. Aug 04 21:11:06.539815 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Aug 04 21:11:06.542006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Returning 404 to user: Instance 46d281c9-228e-4aeb-8054-fb5ac796724e could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:11:06.542006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-801807b3-75a9-4f62-948d-a592c8faa9a9 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e" status: 404 len: 111 microversion: 2.1 time: 0.030407 Aug 04 21:11:06.542006 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 586/1210] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Aug 4 21:11:06 2022] GET /compute/v2.1/servers/46d281c9-228e-4aeb-8054-fb5ac796724e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:11:07.831212 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: DEBUG nova.api.openstack.wsgi [None req-d4f17c51-d536-492e-9640-46f27ca48759 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] Calling method '.version_select at 0x7f2bdbd99dc0>' {{(pid=124352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:11:07.835593 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d4f17c51-d536-492e-9640-46f27ca48759 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [1c33e3a0-e868-4a63-87ce-8d7e6798107c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:11:08.843761 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [None req-d4f17c51-d536-492e-9640-46f27ca48759 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] [1c33e3a0-e868-4a63-87ce-8d7e6798107c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56868. Aug 04 21:11:08.862736 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO nova.api.openstack.requestlog [None req-d4f17c51-d536-492e-9640-46f27ca48759 tempest-TestVolumeBootPattern-818687791 tempest-TestVolumeBootPattern-818687791-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367343419" status: 202 len: 0 microversion: 2.1 time: 1.035518 Aug 04 21:11:08.863322 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: [pid: 124352|app: 0|req: 625/1211] 10.222.0.52 () {58 vars in 1260 bytes} [Thu Aug 4 21:11:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367343419 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:11:18.800556 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:11:18.801240 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:11:27.810710 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:11:27.811176 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:13:01.965964 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:13:01.966836 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:13:27.670554 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:13:27.671136 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:13:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:14:38.809460 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:14:38.810145 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:14:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:14:47.818976 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:14:47.819551 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:16:12.089919 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:16:12.090687 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:16:21.975736 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:16:21.976509 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:16:35.918088 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:16:35.918737 dv-cinder-836027-4-iscsi devstack@n-api.service[124350]: Thu Aug 4 21:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:16:47.679072 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:16:47.679610 dv-cinder-836027-4-iscsi devstack@n-api.service[124352]: Thu Aug 4 21:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!